Commit Graph

452 Commits

Author SHA1 Message Date
Mario Zechner
8419689f11 Clean-up, initial Hofer mapping. 2023-06-21 02:43:04 +02:00
Mario Zechner
303d25ccb5 Categories for Billa & Spar, infra to add catgories for other stores.
Billa maps directly to the canonical categories. Spar uses a mapping file stores/spar-categories.json.

Each store has a generateCategoryMapping() function which is called once in analysis.js:updateData() and analysis.js:replay(). The function is responsible for

* Fetching the latest categories
* Merging them with already mapped categories
* Report new categories that haven't been mapped yet
* Report categories that have been mapped but are no longer part of the latest set of categories
* Save the merged mappings to disk

This schema might not work for all stores, in which case updateData() and replay() will use a knn approach to figure out the category for an item. See #81
2023-06-21 01:29:00 +02:00
Mario Zechner
55b8a79107 Try to unfuck some chart related CSS. 2023-06-20 00:22:22 +02:00
Mario Zechner
18fcf6497e Further simplify README.md 2023-06-19 17:46:09 +02:00
Mario Zechner
35c4117689 Update README.md 2023-06-19 17:45:08 +02:00
Mario Zechner
9f4d06467f Clean-up. 2023-06-19 01:53:08 +02:00
Mario Zechner
b0edbf88a5 Fix id of dm-de items, category of billa items. 2023-06-19 01:52:20 +02:00
Mario Zechner
6569b17da2 Remove binary encoding, web worker, clean-up. 2023-06-18 23:23:02 +02:00
Mario Zechner
be552fcd9e Hard code JSON data usage. 2023-06-18 22:52:32 +02:00
Mario Zechner
ae470972b0 Lower items list batch size for faster rendering. 2023-06-18 22:44:33 +02:00
Mario Zechner
f315d03829 Remove sparSi, use getters instead of precalculated values in item. See #99 145mb - 92mb 2023-06-18 22:35:48 +02:00
Mario Zechner
a93c581ef9 Intern strings. See #99. 2023-06-18 20:29:03 +02:00
Mario Zechner
d636362acc Don't precalculate item url. See #99 166 -> 159mb 2023-06-18 20:14:36 +02:00
Mario Zechner
887c72be64 Require at least 3 characters for queries. 2023-06-18 19:24:07 +02:00
Mario Zechner
be0516fca6 Fix log message. 2023-06-18 17:36:46 +02:00
Mario Zechner
e2b38aec95 Higher debounce delay on mobile. 2023-06-18 16:24:32 +02:00
Mario Zechner
916f7af5ec Add web worker support for loading items. It's much slower than just blocking on the main thread. 2023-06-18 16:16:01 +02:00
Mario Zechner
0d8ed03934 Deploy script. 2023-06-18 15:36:43 +02:00
Mario Zechner
c34c5c7343 Added loader. Stalls because to much work is done on the main thread. Good enough. 2023-06-18 15:35:09 +02:00
Mario Zechner
d13a0e2d55 Final answer. 2023-06-18 14:55:57 +02:00
Mario Zechner
e065057f81 Sigh #2... 2023-06-18 14:53:56 +02:00
Mario Zechner
538bf08d0b Sigh. 2023-06-18 14:51:37 +02:00
Mario Zechner
36d7ce59f0 Settings useJSON isn't what's expected. 2023-06-18 14:50:08 +02:00
Mario Zechner
d01d984706 Fix binary encoding of unit. 2023-06-18 14:45:35 +02:00
Mario Zechner
c578a7e5bc Default to JSON, don't make it an option for now. 2023-06-18 14:42:47 +02:00
Mario Zechner
898fa44ff1 Add description to items where available, use it in search index. 2023-06-17 20:54:45 +02:00
Mario Zechner
ad01cc0658 Add German compound word decomposition. Doesn't help a lot, need more context words apart from product name. 2023-06-17 20:29:43 +02:00
Mario Zechner
b6a9ec80b5 Added BM25 search index implementation. Run node site/js/bm25.js for testing. 2023-06-17 14:40:09 +02:00
Mario Zechner
c7537c341e Binary format optimization 4.4mb -> 3.9mb, don't store urls were not needed, use product-id instead of code-internal for spar items, 2023-06-17 01:11:21 +02:00
Mario Zechner
c9740b8660 Improved compression, 4.8mb -> 4.4mb and faster decoding. 2023-06-16 23:12:37 +02:00
Mario Zechner
d63d42d623 Write store info as part of binary serialization. 2023-06-16 20:38:39 +02:00
Mario Zechner
222720365c Improve binary decoding, make binary default. 2023-06-16 20:03:08 +02:00
Mario Zechner
d8a9da7692 Fix footer. 2023-06-16 19:37:07 +02:00
Mario Zechner
c1e703fd28 Fix cart management (import, save) 2023-06-16 19:24:43 +02:00
Mario Zechner
c7e7d27b53 Go to cart view after new cart was created. 2023-06-16 19:05:47 +02:00
Mario Zechner
ea5c133003 Binary compression (it's worse), unit prices in charts, small improvements. 2023-06-16 16:01:13 +02:00
Mario Zechner
c97c8116f6 "Fix" stepping of single item price lines with magic... 2023-06-16 00:48:51 +02:00
Mario Zechner
258936dc0c Fixed stepped charting. 2023-06-16 00:16:59 +02:00
Mario Zechner
cd429da10b Chart: Re-enable intersection mode, don't back or forward fill anymore 2023-06-16 00:13:12 +02:00
Mario Zechner
0580fa709d Don't backfill prices for charting. 2023-06-15 23:55:28 +02:00
Mario Zechner
1eb01af8a7 Unfuck bundler. 2023-06-15 23:40:20 +02:00
Mario Zechner
4b612c0810 Ignore docs/ in prettier config 2023-06-15 23:26:44 +02:00
Mario Zechner
f37e3c2b4b Fix footer. 2023-06-15 23:12:13 +02:00
Mario Zechner
68b9193a5a Final answer, esbuild hung... 2023-06-15 22:44:49 +02:00
Mario Zechner
d72378deb7 Jebus... 2023-06-15 22:08:56 +02:00
Mario Zechner
b6b4d3f37e One more time. 2023-06-15 22:07:39 +02:00
Mario Zechner
d954f28b1b Last try. 2023-06-15 21:59:14 +02:00
Mario Zechner
228b13d1e4 Try to fix pages. 2023-06-15 21:41:19 +02:00
Mario Zechner
220a0f0486 Add missing = operator... 2023-06-15 21:23:52 +02:00
Mario Zechner
851765878f Try to fix pages. 2023-06-15 21:17:34 +02:00