Multi model refactor#223

Draft

TosinSeg wants to merge 15 commits intodeepspeedai:mainfrom

TosinSeg:multi-model-refactor

Commits on Aug 4, 2023

refactoring configs
mrwyattii
committed

Commits on Aug 9, 2023

fix zero config test failures
mrwyattii
committed
attempt to fix hf_auth error
mrwyattii
committed
Allocating multiple processes
Tosin Segun
committed
Support for multiple deployments in deploy() API
Tosin Segun
committed

Commits on Aug 11, 2023

Load balancer support for multiple models
Tosin Segun
committed
Refacoring and some formatting
Tosin Segun
committed

Commits on Aug 12, 2023

Fixing deserialization
Tosin Segun
committed