Chunk input #2
Open
Chunk input #2
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
value. Chunk the input into chunks of 16. Divide those chucks if they fail. Write succesful chucks immediately so it'll process as much as possible.
Author
|
A couple of things, I realized I left some debug logging in there. |
Command Line Arguments
Author
|
Added support for Google Translate and command line arguments. Google Translate requires adding the module to python, enabling the API in the Google cloud apis, and getting a key. You can just comment out the import and it'll work without Google Translate |
added 2 commits
March 12, 2023 15:37
GoogleTranslate and OpenAITranslator implement fetch to get the translated string. Added Documentation. Cleaned up python code a bit so it uses python common style.
Author
|
Changed the code to use classes. |
that were coming back with the placeholders munged.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Upped max_tokens to 1024, it was failing on some things with the lower value.
Chunk the input into chunks of 16.
Divide those chucks if they fail.
Write successful chucks immediately so it'll process as much as possible.
With these changes, I'm able to translate my apps strings (313) into Ukrainian. It handled 311 of 313 strings.