You may want to consider using the Quart framework, which is API-compatible with Flask but uses the ASGI interface to better handle long-running requests and multiple concurrent requests.

Through five courses, this bundle will teach you everything you need to know about not only Python, but also Python Flask development, API design, web development, coding tricks and time-savers ...

The API was then modified to run the model in multiple processes, but not Flask. It was further refined to use PyTorch’s multi-processing feature to distribute the model across multiple processes.