Support other types of `ContentPart`

[GodTamIt]

Things like InlineData, FileData, or VideoMetadata can also be considered parts of content.

[josh-tracey]

InlineData, and FileData has been addressed by 831efef thanks to @grandmasponge. Will add VideoMetadata support and example at some point soon, if not beaten to it.

[sdtnjung]

I stumbled over this issue because I thought adding Files is not supported yet. So is the idea to construct a custom JSON that embeds the encoded file content?

Would it not be nice to have helper utils such as (add_text, add_json_file) for constructing that req_json ? Looks a bit error prone to me.

gemini-client/examples/inline_data.rs

Lines 18 to 40 in 831efef

	let peom = String::from("YSBtZW93IGhlcmUgYSBtZW93IHRoZXJlIGEgbWVvdyAuLi4=");
	let req_json = json!({
	"contents": [
	{
	"parts": [
	{
	"text": "finish the rest of this poem"
	},
	{
	"inlineData" : {
	"mimeType": "text/plain",
	"data" : peom
	}
	}
	],
	"role": "user"
	}
	],
	"tools": []
	});
	let request: GenerateContentRequest = serde_json::from_value(req_json)?;

[josh-tracey]

    let peom = String::from("YSBtZW93IGhlcmUgYSBtZW93IHRoZXJlIGEgbWVvdyAuLi4=");

    let request = GenerateContentRequest {
        contents: vec![Content {
            parts: vec![
                ContentPart {
                    data: ContentData::Text("finish the rest of this poem".to_string()),
                    thought: false,
                    metadata: None,
                },
                ContentPart {
                    data: ContentData::InlineData(InlineData {
                        mime_type: "text/plain".to_string(),
                        data: peom,
                    }),
                    thought: false,
                    metadata: None,
                },
            ],
            role: Some(Role::User),
        }],
        tools: vec![],
        system_instruction: None,
        tool_config: None,
        generation_config: None,
    };

    let response = client.generate_content(model_name, &request).await?;

If you want type safety over the json! can just use the types defined in gemini_client_rs::types

GenerateContentRequest is the type for the request