Why Tinker

[zyy07]

Thank you for sharing this great work! 😊
Is the main benefit of using Tinker to make the experiments accessible to users without GPU resources? Were there other reasons for adding the Tinker implementation?

[ultmaster]

Correctly setting up the experiments locally for LLMs is hard, especially the large-scale ones. See the "verl"-related issues in this forum. With Tinker, you can completely offload that part of burden to a third-party service, also with a very competitive money cost.

Also, the API of Tinker is much simpler and easier to integrate compared to verl.