Commit Graph

85 Commits

Author SHA1 Message Date
Mario Zechner
bb11db1520 Preisgesenkt Billa list parsing and matching. 2023-06-27 14:48:56 +02:00
Mario Zechner
6251c06b59 Penny category mapper fix. 2023-06-26 17:13:16 +02:00
Mario Zechner
7c064e30c9 Penny categories update 2023-06-26 10:55:37 +02:00
Mario Zechner
89f392c3ae Penny categories update. 2023-06-26 10:53:41 +02:00
Mario Zechner
930fe762d3 Update Penny categories 2023-06-26 02:45:56 +02:00
Mario Zechner
d46c7f98b4 Fix Unimarkt category mappings. 2023-06-24 20:56:01 +02:00
Mario Zechner
fc10054bd2
Merge pull request #105 from tiefenb/main
Unimarkt Categories
2023-06-24 20:52:52 +02:00
Mario Zechner
ce1aa31d45 Media reports page 2023-06-24 18:55:51 +02:00
Mario Zechner
f5940dcd79 CSV export, for details see https://docs.google.com/document/d/1Q5OWJOICXjSzTEIHBZgJl1p3FsiWFO0lzXIuwGbXBck/edit#heading=h.2nh5hygulv36 2023-06-23 23:01:03 +02:00
Markus Tiefenbacher
2e2af585ef
Merge branch 'badlogic:main' into main 2023-06-23 08:08:33 +02:00
Markus Tiefenbacher
eeff2abab6 Unimarkt Categories 2023-06-22 23:56:20 +02:00
Mario Zechner
9420c3ae3e Penny categories. 2023-06-22 23:54:44 +02:00
Mario Zechner
29e827c71d Fix Lidl bio handling and budget brands. See #93 2023-06-22 22:55:25 +02:00
Mario Zechner
ffe4f4c4f8 Don't ignore unavailable. 2023-06-22 12:40:58 +02:00
Mario Zechner
97b4b25933 Show alaSQL errors in the UI. 2023-06-21 21:29:57 +02:00
Mario Zechner
c3abf97363 More import fixes. 2023-06-21 18:28:35 +02:00
Mario Zechner
d16c7005d6 More import fixes. 2023-06-21 18:27:32 +02:00
Mario Zechner
807c6e90e2 Fix import. 2023-06-21 18:25:21 +02:00
Mario Zechner
bb2511eefc Use local category file instead of querying site. 2023-06-21 18:20:36 +02:00
Mario Zechner
60ecb68924 Mark unavailable items in data and with 💀 in ui, add emojis to category names, hide filter groups if ! query, 2023-06-21 17:07:45 +02:00
Mario Zechner
d9ed69f578 Fix Penny URLs, invert category filter checkbox logic. 2023-06-21 16:15:05 +02:00
Mario Zechner
f2ef75e5c4 Remove old entries for discount only stores. Closes #102 2023-06-21 16:00:59 +02:00
Mario Zechner
b05702aff5 Hofer and MPREIS categories. 2023-06-21 15:20:28 +02:00
Mario Zechner
8419689f11 Clean-up, initial Hofer mapping. 2023-06-21 02:43:04 +02:00
Mario Zechner
303d25ccb5 Categories for Billa & Spar, infra to add catgories for other stores.
Billa maps directly to the canonical categories. Spar uses a mapping file stores/spar-categories.json.

Each store has a generateCategoryMapping() function which is called once in analysis.js:updateData() and analysis.js:replay(). The function is responsible for

* Fetching the latest categories
* Merging them with already mapped categories
* Report new categories that haven't been mapped yet
* Report categories that have been mapped but are no longer part of the latest set of categories
* Save the merged mappings to disk

This schema might not work for all stores, in which case updateData() and replay() will use a knn approach to figure out the category for an item. See #81
2023-06-21 01:29:00 +02:00
Mario Zechner
b0edbf88a5 Fix id of dm-de items, category of billa items. 2023-06-19 01:52:20 +02:00
Mario Zechner
6569b17da2 Remove binary encoding, web worker, clean-up. 2023-06-18 23:23:02 +02:00
Mario Zechner
d01d984706 Fix binary encoding of unit. 2023-06-18 14:45:35 +02:00
Mario Zechner
898fa44ff1 Add description to items where available, use it in search index. 2023-06-17 20:54:45 +02:00
Mario Zechner
c7537c341e Binary format optimization 4.4mb -> 3.9mb, don't store urls were not needed, use product-id instead of code-internal for spar items, 2023-06-17 01:11:21 +02:00
Mario Zechner
1d2eb5315e Fix some Hofer unit/quantity mistakes, add price per unit to frontend. 2023-06-13 10:09:52 +02:00
Mario Zechner
2d394c2f4a Sigh, runtime error. 2023-06-13 01:20:16 +02:00
Mario Zechner
031114ebca The great refactor. 2023-06-13 01:16:27 +02:00
Mario Zechner
fce2f928c7 Spar SI fixes 2023-06-12 15:31:46 +02:00
Mario Zechner
5c65236f6c Spar Slovenia. 2023-06-12 13:08:51 +02:00
Matthias Hochsteger
17f5b5add4 Fix unimarkt units
Use 1 stk as fallback (7 articles so far).
The other 20 are using "mbe" -> wg (Waschgang).
2023-06-06 21:19:30 +02:00
Mario Zechner
689d191769
Merge pull request #77 from tiefenb/main
Add missing unimarkt "haushalt" category
2023-06-06 20:50:22 +02:00
Matthias Hochsteger
e66121e2f2 Use price-per-unit field for weighted products in spar (seems most robust) 2023-06-06 20:38:48 +02:00
Mario Zechner
cb93299990 Fix sorting by name similarity, Billa deduplication. 2023-06-06 18:36:55 +02:00
Markus Tiefenbacher
f76be098c4 Add missing unimarkt "haushalt" category
Products like pet food, soap, shampoo, etc.
2023-06-06 16:55:22 +02:00
Mario Zechner
a5cd0f5de8 Fetch Billa data by category. Yields more items. Can be used for categorizing other store items, see categorize.js. 2023-06-06 15:15:39 +02:00
Mario Zechner
9d58e20bbd Fixes #74, fall back fetching REWEDE from GitHub pages. 2023-06-05 23:04:03 +02:00
Mario Zechner
f60436b59b More Spar unit fixing. 2023-06-05 22:06:38 +02:00
Mario Zechner
91f30e553f Don't lowercase Spar item names. 2023-06-05 21:59:35 +02:00
Mario Zechner
d30ef57d9b Fix a bunch of SPAR unit/quantity issues. See #71. 2023-06-05 21:42:57 +02:00
Mario Zechner
4f4c42126a Fix restore for Dossier data. 2023-06-05 21:14:10 +02:00
Mario Zechner
f83af199e6
Merge pull request #73 from mhochsteger/fix_spar_quantities_with_tausendertrennpunkt
Fix quantities with "Tausendertrennpunkt" in Spar
2023-06-05 14:45:36 +02:00
Matthias Hochsteger
11e40125f6 Fix quantities with "Tausendertrennpunkt" in Spar
Didn't dare to ignore dots globally, as I discovered stuff like "500.000 GR" in
MPREIS data.

Fixes #71
2023-06-05 14:42:42 +02:00
Matthias Hochsteger
505b3c75b3 fallback argument in convertUnit
Fixes #70
2023-06-05 14:26:42 +02:00
simmac
632c0db6b0 Fixed DM-DE queries.
Fixes #45
2023-06-04 23:42:15 +02:00