'How can we increase the rate limit of goggle dlp api
The rate limit set as 600 req/min by default is very low for our application where we are trying to process millions of records through a Spark job. Even with cluster of 16 nodes and 4 cores we are hitting the rate limit. We plan to have 25 such jobs running in parallel. Can you please suggest how the rate limit can be increased to something like 20k per min
Solution 1:[1]
https://cloud.google.com/docs/quota is the source documentation for Google Cloud quotas.
Once you submit your quota request we'll send you some follow up questions to help us calculate the capacity needs to grant it, so keep an eye out for that email.
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|---|
| Solution 1 | Jordanna Chord |