Jo eh.
Go to file
Mario Zechner d7af971798 Category files may change, git checkout before deployment. 2023-06-23 23:01:53 +02:00
.github/workflows Print date in workflow 2023-06-01 19:45:14 +02:00
.husky Remove husky from package.json, add pre-commit hook to .husky instead. 2023-06-03 00:41:04 +02:00
.vscode WIP esbuild, bundling, components. 2023-06-08 13:48:08 +02:00
docker Huh, unknown directive "etag_hash" 2023-06-11 23:54:34 +02:00
site CSV export, for details see https://docs.google.com/document/d/1Q5OWJOICXjSzTEIHBZgJl1p3FsiWFO0lzXIuwGbXBck/edit#heading=h.2nh5hygulv36 2023-06-23 23:01:03 +02:00
stores CSV export, for details see https://docs.google.com/document/d/1Q5OWJOICXjSzTEIHBZgJl1p3FsiWFO0lzXIuwGbXBck/edit#heading=h.2nh5hygulv36 2023-06-23 23:01:03 +02:00
.editorconfig Add prettier 2023-06-02 07:34:32 +02:00
.gitignore First pass, everything is broken. 2023-06-03 22:00:52 +02:00
.prettierignore Remove old entries for discount only stores. Closes #102 2023-06-21 16:00:59 +02:00
.prettierrc Increased maxWidth to 150 in prettier config, formatted all the things. See #52. 2023-06-02 16:45:54 +02:00
LICENSE Initial commit 2023-05-08 16:51:43 +02:00
README.md Further simplify README.md 2023-06-19 17:46:09 +02:00
analysis.js Re-evaluate unavailable flag on every history merge. 2023-06-21 21:21:30 +02:00
bundle.js Remove binary encoding, web worker, clean-up. 2023-06-18 23:23:02 +02:00
categorize.js Clean-up, initial Hofer mapping. 2023-06-21 02:43:04 +02:00
deploy.sh Category files may change, git checkout before deployment. 2023-06-23 23:01:53 +02:00
h43z.js Binary format optimization 4.4mb -> 3.9mb, don't store urls were not needed, use product-id instead of code-internal for spar items, 2023-06-17 01:11:21 +02:00
migrate.js Refactor migration, switch from gzip to brotli compression. See #44 2023-06-03 00:01:41 +02:00
package-lock.json Add German compound word decomposition. Doesn't help a lot, need more context words apart from product name. 2023-06-17 20:29:43 +02:00
package.json Show alaSQL errors in the UI. 2023-06-21 21:29:57 +02:00
pages.js Final answer, esbuild hung... 2023-06-15 22:44:49 +02:00
pages.sh Ignore docs/ in prettier config 2023-06-15 23:26:44 +02:00
postcss.config.js add tailwind build process 2023-06-07 15:00:15 +02:00
restore.js Hofer and MPREIS categories. 2023-06-21 15:20:28 +02:00
server.js CSV export, for details see https://docs.google.com/document/d/1Q5OWJOICXjSzTEIHBZgJl1p3FsiWFO0lzXIuwGbXBck/edit#heading=h.2nh5hygulv36 2023-06-23 23:01:03 +02:00
stats.sh Fix Billa weighted item prices analogously to Spar. See #10 2023-05-20 15:38:40 +02:00
tailwind.config.js Improve performance 2023-06-07 23:37:53 +02:00

README.md

Heisse Preise

A terrible grocery price search "app". Fetches data from big Austrian grocery chains daily and lets you search them. See https://heisse-preise.io.

The project consists of a trivial NodeJS Express server responsible for fetching the product data, massaging it, and serving it to the front end (see server.js). The front end is a least-effort vanilla HTML/JS app (see sources in site/).

Requirements

  • Node.js

Running

Development

Install NodeJS, then run this in a shell of your choice.

git clone https://github.com/badlogic/heissepreise
cd heissepreise
mkdir -p data
npm install
npm run dev

The first time you run this, the data needs to be fetched from the stores. You should see log out put like this.

Fetching data for date: 2023-05-23
Fetched LIDL data, took 0.77065160000324 seconds
Fetched MPREIS data, took 13.822936070203781 seconds
Fetched SPAR data, took 17.865891209602356 seconds
Fetched BILLA data, took 52.95784649944306 seconds
Fetched HOFER data, took 64.83968291568756 seconds
Fetched DM data, took 438.77065160000324 seconds
Merged price history
App listening on port 3000

Once the app is listening per default on port 3000, open http://localhost:3000 in your browser.

Subsequent starts will fetch the data asynchronously, so you can start working immediately.

Production

Install the dependencies as per above, then simply run:

git clone https://github.com/badlogic/heissepreise
cd heissepreise
npm install
npm run dev

Once the app is listening per default on port 3000, open http://localhost:3000 in your browser.

Using data from heisse-preise.io

You can also get the raw data. The raw data is returned as a JSON array of items. An item has the following fields:

  • store: (billa, spar, hofer, dm, lidl, mpreis, ...)
  • name: the product name.
  • price: the current price in €.
  • priceHistory: an array of { date: "yyyy-mm-dd", price: number } objects, sorted in descending order of date.
  • unit: unit the product is sold at. May be undefined.
  • quantity: quantity the product is sold at for the given price
  • bio: whether this product is classified as organic/"Bio"

If you run the project locally, you can use the data from the live site including the historical data as follows:

cd heisse-preise
rm data/latest-canonical.*
curl -O data/latest-canonical.json https://heisse-preise.io/data/latest-canonical.json

Restart the server with either npm run dev or npm run start.

Historical Data Credits

The live site at heisse-preise.io feature historical data from: