How to request quota

[ppKrauss]

I can use other IP, but ideal is to request more quota for my IP... How to request quota?

PS: both, http://overpass-turbo.eu and http://overpass-api.de/api/interpreter?data= with same error message.

[mmd-osm]

If you exceed your quota this means you're sending too many, and/or too expensive queries and therefore create too much load on the server!

You have the following options:

• wait for some time
• switch to another server (see wiki page for alternatives)
• set up your own Overpass instance
• optimize your query to be less expensive

As the public servers are shared resources (which are provided for free to you btw) and have a total capacity limit, there's no way to increase your personal quota without affecting other users.

[mmd-osm]

BTW: you have been asked multiple times to run your full planet Wikidata analysis on a local planet file instead. You seem to totally ignore those recommendations and keep on posting messages like the following:

https://help.openstreetmap.org/questions/65130/why-http-request-failed

https://gis.stackexchange.com/questions/288751/how-to-generate-a-csv-file-from-overpass-with-id-and-tag-value

This behavior is not acceptable. OSMBrasil/semantic-bridge#2 needs to stop right now.

[ppKrauss]

Hi @mmd-osm , the "full planet Wikidata analysis" is not a goal to this year (!), and we need money to run the planet in a server... For now we elected AR, BR, GW (all little-data) and DE (the only big-data).

[mmd-osm]

Please download the respective country extract from download.geofabrik.de and use osmium tool to extract those wikidata features instead. You can run this on your laptop, as often as you like.

[ppKrauss]

@mmd-osm thanks, I will delete questions to avoid other people testing big-data queries...

---

Using apt in a DigitalOcean's 2 GB Memory / 60 GB Disk / Ubuntu 16.04.3 x64.

osmium --version
osmium version 1.3.0

df -h
Filesystem      Size  Used Avail Use% Mounted on
tmpfs           201M   21M  180M  11% /run
/dev/vda1        58G   15G   44G  26% /
...    ...

So, lets try the so big Europe with its 18.3 GB of .osm.pbf...

[ppKrauss]

Hi @mmd-osm , I installed newer (!), "osmium version 1.7.1 / libosmium version 2.13.1"...

I am looking for the "recipe" of the query, to obtain a CSV file as <wikdidata-id,osm_type,osm_id> as minimal goal.

1. osmium tags-filter liechtenstein-latest.osm.pbf w/wikidata -o wikidata-in-liechtenstein-latest.osm.pbf
2. hum... ? osmium show wikidata-in-liechtenstein-latest.osm.pbf shows the osm_type and osm_id but no Wikidata-ID, that is the tag-value. ... No Google or osmium-tool/manual information about extract datasets.

[ppKrauss]

.... Will solve as a simple XML attribute extraction problem, instead a "looking for tool and query" problem... The basic is working (!). Example:

1. osmium tags-filter germany-latest.osm.pbf nwr/wikidata -o wikidata-in-germany-latest.osm.pbf
2. osmium cat -f osm wikidata-in-germany-latest.osm.pbf -o wikidata-in-germany.osm
3. so.. now we can test a so basic XML extraction ...
   grep wikidata wikidata-in-germany.osm | wc -l = 76572
   grep wikidata wikidata-in-germany.osm | uniq -u | wc -l = 67934

[mmd-osm]

You could try the OPL output format - it will return all information for an object in a single line: https://osmcode.org/opl-file-format/

If you really need CSV output, you should probably also take a look at osmconvert (for step 3 only) : https://wiki.openstreetmap.org/wiki/Osmconvert#Writing_CSV_Files

[mmd-osm]

In case there are no further questions please close this issue. Thanks!

[matkoniecz]

@mmd-osm Can you consider closing this?