Skip to content

Make model listing faster #250

@nlathia

Description

@nlathia

another nice to have -> some performance (latency) improvements around methods like list_models i haven't had the chance to take an in depth look but at first guess, probably adding async / multithreading for the IO blocking parts or using ujson instead of json for loading the jsons?

https://mlops-community.slack.com/archives/C0227QJCDS8/p1687856991359489?thread_ts=1687777412.934619&cid=C0227QJCDS8

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions