Commit Graph

108 Commits

Author SHA1 Message Date
Mario Zechner
a738dad8e1 Closes #134, filter out 0 prices. Bad data is bad. 2023-07-11 15:36:40 +02:00
Mario Zechner
dd938ba7cd Closes #135
Penny now has a subcategory that leads back to the all categories page. This triggered an infinite recursion which eventually goes OOM boom.
2023-07-11 15:31:02 +02:00
Mario Zechner
36fd2e9705 Fixes #129 2023-07-05 20:32:09 +02:00
Mario Zechner
958c9f2d00
Merge pull request #128 from tiefenb/bipa
Add Bipa
2023-07-05 20:21:52 +02:00
Mario Zechner
69ecdb6a4f
Merge pull request #126 from unki2aut/dm-adjust-queries
DM adjust queries
2023-07-05 20:21:07 +02:00
Markus Tiefenbacher
b3917cfa0b Fix Bipa category matching 2023-07-02 23:23:34 +02:00
Markus Tiefenbacher
56239e5e39 Whoopsi - forgot to remove comments 2023-07-02 23:21:02 +02:00
Markus Tiefenbacher
410f630721 Add more Bipa categories and first mapping 2023-07-02 23:10:39 +02:00
Markus Tiefenbacher
05e03535a0 Fix Bipa categories 2023-07-02 22:30:35 +02:00
Markus Tiefenbacher
f3f0702cbb Add Bipa 2023-07-02 21:25:37 +02:00
Martin Fillafer
3884c2ad1b Fix logical OR issue 2023-06-30 16:35:31 +02:00
Martin Fillafer
03b7d24d01 Adjust DM queries 2023-06-30 16:25:38 +02:00
Markus Tiefenbacher
acaa1f2787 Optimization of Mueller Categories 2023-06-30 10:23:27 +02:00
Markus Tiefenbacher
e1de63e040 Missing Mueller categories 2023-06-30 08:44:12 +02:00
Markus Tiefenbacher
af30fdbb44 New Mueller categories 2023-06-30 08:27:25 +02:00
Markus Tiefenbacher
75e9b0116c Add Muller categories 2023-06-30 08:24:37 +02:00
Markus Tiefenbacher
cbb58c8dfc Add Mueller Categories (not ready mapped yet) 2023-06-29 23:03:23 +02:00
Mario Zechner
56485cd72f Expontential backoff for Mueller. 2023-06-29 17:34:23 +02:00
Mario Zechner
cdda5b2b5c Fix Spar Windel category. 2023-06-29 15:11:00 +02:00
Mario Zechner
31298ff52c Hofer categories. 2023-06-29 14:57:54 +02:00
Mario Zechner
1c6611a171 New Penny categories. 2023-06-29 14:57:28 +02:00
Markus Tiefenbacher
69842daf04 Add Müller Austria and Müller Germany without categorization 2023-06-28 22:41:39 +02:00
Mario Zechner
f5998383f5 Fix loading of carts, only add items for which lookup succeeds. 2023-06-28 11:15:34 +02:00
Mario Zechner
bb11db1520 Preisgesenkt Billa list parsing and matching. 2023-06-27 14:48:56 +02:00
Mario Zechner
6251c06b59 Penny category mapper fix. 2023-06-26 17:13:16 +02:00
Mario Zechner
7c064e30c9 Penny categories update 2023-06-26 10:55:37 +02:00
Mario Zechner
89f392c3ae Penny categories update. 2023-06-26 10:53:41 +02:00
Mario Zechner
930fe762d3 Update Penny categories 2023-06-26 02:45:56 +02:00
Mario Zechner
d46c7f98b4 Fix Unimarkt category mappings. 2023-06-24 20:56:01 +02:00
Mario Zechner
fc10054bd2
Merge pull request #105 from tiefenb/main
Unimarkt Categories
2023-06-24 20:52:52 +02:00
Mario Zechner
ce1aa31d45 Media reports page 2023-06-24 18:55:51 +02:00
Mario Zechner
f5940dcd79 CSV export, for details see https://docs.google.com/document/d/1Q5OWJOICXjSzTEIHBZgJl1p3FsiWFO0lzXIuwGbXBck/edit#heading=h.2nh5hygulv36 2023-06-23 23:01:03 +02:00
Markus Tiefenbacher
2e2af585ef
Merge branch 'badlogic:main' into main 2023-06-23 08:08:33 +02:00
Markus Tiefenbacher
eeff2abab6 Unimarkt Categories 2023-06-22 23:56:20 +02:00
Mario Zechner
9420c3ae3e Penny categories. 2023-06-22 23:54:44 +02:00
Mario Zechner
29e827c71d Fix Lidl bio handling and budget brands. See #93 2023-06-22 22:55:25 +02:00
Mario Zechner
ffe4f4c4f8 Don't ignore unavailable. 2023-06-22 12:40:58 +02:00
Mario Zechner
97b4b25933 Show alaSQL errors in the UI. 2023-06-21 21:29:57 +02:00
Mario Zechner
c3abf97363 More import fixes. 2023-06-21 18:28:35 +02:00
Mario Zechner
d16c7005d6 More import fixes. 2023-06-21 18:27:32 +02:00
Mario Zechner
807c6e90e2 Fix import. 2023-06-21 18:25:21 +02:00
Mario Zechner
bb2511eefc Use local category file instead of querying site. 2023-06-21 18:20:36 +02:00
Mario Zechner
60ecb68924 Mark unavailable items in data and with 💀 in ui, add emojis to category names, hide filter groups if ! query, 2023-06-21 17:07:45 +02:00
Mario Zechner
d9ed69f578 Fix Penny URLs, invert category filter checkbox logic. 2023-06-21 16:15:05 +02:00
Mario Zechner
f2ef75e5c4 Remove old entries for discount only stores. Closes #102 2023-06-21 16:00:59 +02:00
Mario Zechner
b05702aff5 Hofer and MPREIS categories. 2023-06-21 15:20:28 +02:00
Mario Zechner
8419689f11 Clean-up, initial Hofer mapping. 2023-06-21 02:43:04 +02:00
Mario Zechner
303d25ccb5 Categories for Billa & Spar, infra to add catgories for other stores.
Billa maps directly to the canonical categories. Spar uses a mapping file stores/spar-categories.json.

Each store has a generateCategoryMapping() function which is called once in analysis.js:updateData() and analysis.js:replay(). The function is responsible for

* Fetching the latest categories
* Merging them with already mapped categories
* Report new categories that haven't been mapped yet
* Report categories that have been mapped but are no longer part of the latest set of categories
* Save the merged mappings to disk

This schema might not work for all stores, in which case updateData() and replay() will use a knn approach to figure out the category for an item. See #81
2023-06-21 01:29:00 +02:00
Mario Zechner
b0edbf88a5 Fix id of dm-de items, category of billa items. 2023-06-19 01:52:20 +02:00
Mario Zechner
6569b17da2 Remove binary encoding, web worker, clean-up. 2023-06-18 23:23:02 +02:00