Skip to content

Extract Job Creation Throttle #866

@xxklll

Description

@xxklll

I am running into a status code 429, exceeding the rate for job creation currently set at 15/sec. I am using the "agent.queue_extraction()" function from the documentation to bulk upload files to run asynchronously. It would be great if there was an argument included in the function to limit the job creation rate similar to what is included in the aiometer library to avoid running into this as it is currently out of my control to avoid this error.

Image

Screenshot of error attached

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions