Mario Zechner
3638b80c02
Refactor migration, switch from gzip to brotli compression. See #44
...
See migration.js if you want to manually convert raw data files between formats.
2023-06-03 00:01:41 +02:00
Werner Robitza
de75e6686b
skip already gzipped files in json -> gzip migration
2023-06-02 20:08:05 +02:00
Mario Zechner
23f512087e
Refactored and fix #55
...
- `readJson()` now just checks for the file extension to decide whether to uncompress instead of taking a flag.
- moved migration logic from index.js to analysis.js:migrateToGzip
- fixed `restore()` in analysis.js
- also calling `migrateToGzip()` in replay.js
- Fix billa canonicalization for Dossier data
- Fix spar canonicalization for Dossier data and data from 2022.
2023-06-02 18:34:14 +02:00
Mario Zechner
8bf0d65d89
Merge branch 'main' into compress-json
2023-06-02 16:56:22 +02:00
Mario Zechner
c6bbd0e03b
Increased maxWidth to 150 in prettier config, formatted all the things. See #52 .
2023-06-02 16:45:54 +02:00
Christian Tschugg
02bd7e5ff8
Compress raw data files on disk, fixes badlogic/heissepreise#51
2023-06-02 16:24:58 +02:00
Mario Zechner
6b1f84cfe3
Manually merged PR #48 , Penny support (only gets us 275 products)
2023-06-01 14:40:28 +02:00
Mario Zechner
2a53cbd91a
Added Rewe Germany
2023-06-01 01:09:25 +02:00
Mario Zechner
1270002b99
Initial DM Germany support.
2023-05-30 19:29:33 +02:00
Mario Zechner
74ce151c7d
Merge pull request #42 from iantsch/fetch-canonical-parallel
...
Fetch canonical compressed in parallel
2023-05-30 13:57:14 +02:00
Christian Tschugg
0f5a08d723
Fetch canonical compressed in parallel
2023-05-30 13:09:27 +02:00
Christian Tschugg
fe7c79e314
Fix old data conversion issue
2023-05-30 11:51:05 +02:00
Mario Zechner
f26b5c3625
Closes #34
2023-05-30 10:34:25 +02:00
HannesOberreiter
f497f1259f
style: 🔥 remove unused variables
2023-05-29 16:06:47 +02:00
Mario Zechner
55af83b3d0
Fix replay(), fix thead see #27
2023-05-26 16:05:42 +02:00
Christian Tschugg
f2ffe5957d
Refactor to generic store syntax
2023-05-26 12:45:30 +02:00
Mario Zechner
4d7645efaf
Add query link generation.
2023-05-26 11:28:40 +02:00
Mario Zechner
9b907b52b1
Fix up restore(), mergePriceHistory(), sort items by store and name before writting canonical list. Closes #23
2023-05-26 08:56:58 +02:00
simmac
8711edb503
Added MPREIS support
2023-05-26 00:34:26 +02:00
Christian Tschugg
21ef1c9dae
Fetch data in parallel
2023-05-25 16:17:56 +02:00
Christian Tschugg
066f147728
Refactor lidl fallback unit to empty string
2023-05-25 14:24:34 +02:00
Christian Tschugg
661ca82f6c
Add limited support for LIDL
2023-05-25 14:03:19 +02:00
Mario Zechner
c54f9261df
Sort of fix CSS for mobile. Filter in Preisänderungen.
2023-05-25 13:32:53 +02:00
Simeon Macke (01505675)
fadb104d72
Add DM support
2023-05-25 12:28:12 +02:00
Simeon Macke (01505675)
72f913ea76
Add filter for "bio"/organic
2023-05-24 17:26:51 +02:00
Mario Zechner
32bc64c532
Revert Billa endpoint.
2023-05-22 14:24:26 +02:00
Mario Zechner
856f08c71f
Don't use store-id for Billa, will omit products otherwise.
2023-05-22 13:54:38 +02:00
Mario Zechner
ce70ef02a3
Actually fix weighted item prices for Billa. See #10
2023-05-20 15:46:52 +02:00
Mario Zechner
46bc81dff3
Fix Billa weighted item prices analogously to Spar. See #10
2023-05-20 15:38:40 +02:00
Matthias Hochsteger
a08c3115c8
Fix wrong price/unit pairing in some SPAR items
...
Some Spar articles (I assume the ones in "Bedienung") have wrong price or unit.
See this one for example: https://www.interspar.at/shop/lebensmittel/search/?q=Woerle%20Emmentaler%20aus%20Sommermilch
Use 'price-per-unit' if the 'quantity-selector' field is available.
2023-05-19 19:04:19 +02:00
Mario Zechner
87e5e8dc96
Don't call replay in analysis.js...
2023-05-18 21:18:08 +02:00
Mario Zechner
ab8f78f0e3
Fix hofer canonization, lazy loading, replay.
2023-05-18 21:15:42 +02:00
Mario Zechner
d7a8816cc0
Fixed replay().
2023-05-18 20:30:26 +02:00
Mario Zechner
2e7b783739
Formatting. If latest-canonical.json exists, load it and serve data immediately.
2023-05-18 18:34:14 +02:00
Matthias Hochsteger
fe27a2a87d
Generate Hofer access token
2023-05-18 14:18:52 +02:00
Matthias Hochsteger
c94472eb25
Hofer support
...
TODO: Currently an authorization token must be hard-coded, otherwise
fetching hofer data will be skipped
2023-05-18 13:41:09 +02:00
Mario Zechner
d7b6f6f25f
Refactoring.
2023-05-17 16:17:45 +02:00
