You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Calling a Prompt calls the model provider before logging
623
+
the request, responses and metadata to Humanloop.
624
+
625
+
You can use query parameters `version_id`, or `environment`, to target
626
+
an existing version of the Prompt. Otherwise the default deployed version will be chosen.
627
+
628
+
Instead of targeting an existing version explicitly, you can instead pass in
629
+
Prompt details in the request body. In this case, we will check if the details correspond
630
+
to an existing version of the Prompt. If they do not, we will create a new version. This is helpful
631
+
in the case where you are storing or deriving your Prompt details in code.
632
+
</dd>
633
+
</dl>
634
+
</dd>
635
+
</dl>
636
+
637
+
#### 🔌 Usage
638
+
639
+
<dl>
640
+
<dd>
641
+
642
+
<dl>
643
+
<dd>
644
+
645
+
```python
646
+
import datetime
647
+
648
+
from humanloop import Humanloop
649
+
650
+
client = Humanloop(
651
+
api_key="YOUR_API_KEY",
652
+
)
653
+
response = client.prompts.call_stream(
654
+
version_id="string",
655
+
environment="string",
656
+
path="string",
657
+
id="string",
658
+
messages=[
659
+
{
660
+
"content": "string",
661
+
"name": "string",
662
+
"tool_call_id": "string",
663
+
"role": "user",
664
+
"tool_calls": [
665
+
{
666
+
"id": "string",
667
+
"type": "function",
668
+
"function": {"name": "string"},
669
+
}
670
+
],
671
+
}
672
+
],
673
+
prompt={"model": "string"},
674
+
inputs={"string": {"key": "value"}},
675
+
source="string",
676
+
metadata={"string": {"key": "value"}},
677
+
start_time=datetime.datetime.fromisoformat(
678
+
"2024-01-15 09:30:00+00:00",
679
+
),
680
+
end_time=datetime.datetime.fromisoformat(
681
+
"2024-01-15 09:30:00+00:00",
682
+
),
683
+
source_datapoint_id="string",
684
+
trace_parent_id="string",
685
+
user="string",
686
+
prompts_call_stream_request_environment="string",
687
+
save=True,
688
+
log_id="string",
689
+
provider_api_keys={
690
+
"openai": "string",
691
+
"ai_21": "string",
692
+
"mock": "string",
693
+
"anthropic": "string",
694
+
"bedrock": "string",
695
+
"cohere": "string",
696
+
"openai_azure": "string",
697
+
"openai_azure_endpoint": "string",
698
+
},
699
+
num_samples=1,
700
+
return_inputs=True,
701
+
logprobs=1,
702
+
suffix="string",
703
+
)
704
+
for chunk in response:
705
+
yield chunk
706
+
707
+
```
708
+
</dd>
709
+
</dl>
710
+
</dd>
711
+
</dl>
712
+
713
+
#### ⚙️ Parameters
714
+
715
+
<dl>
716
+
<dd>
717
+
718
+
<dl>
719
+
<dd>
720
+
721
+
**version_id:**`typing.Optional[str]` — A specific Version ID of the Prompt to log to.
722
+
723
+
</dd>
724
+
</dl>
725
+
726
+
<dl>
727
+
<dd>
728
+
729
+
**environment:**`typing.Optional[str]` — Name of the Environment identifying a deployed version to log to.
730
+
731
+
</dd>
732
+
</dl>
733
+
734
+
<dl>
735
+
<dd>
736
+
737
+
**path:**`typing.Optional[str]` — Path of the Prompt, including the name. This locates the Prompt in the Humanloop filesystem and is used as as a unique identifier. For example: `folder/name` or just `name`.
738
+
739
+
</dd>
740
+
</dl>
741
+
742
+
<dl>
743
+
<dd>
744
+
745
+
**id:**`typing.Optional[str]` — ID for an existing Prompt.
746
+
747
+
</dd>
748
+
</dl>
749
+
750
+
<dl>
751
+
<dd>
752
+
753
+
**messages:**`typing.Optional[typing.Sequence[ChatMessageParams]]` — The messages passed to the to provider chat endpoint.
Controls how the model uses tools. The following options are supported:
764
+
-`'none'` means the model will not call any tool and instead generates a message; this is the default when no tools are provided as part of the Prompt.
765
+
-`'auto'` means the model can decide to call one or more of the provided tools; this is the default when tools are provided as part of the Prompt.
766
+
-`'required'` means the model can decide to call one or more of the provided tools.
767
+
-`{'type': 'function', 'function': {name': <TOOL_NAME>}}` forces the model to use the named function.
768
+
769
+
</dd>
770
+
</dl>
771
+
772
+
<dl>
773
+
<dd>
774
+
775
+
**prompt:**`typing.Optional[PromptKernelRequestParams]` — Details of your Prompt. A new Prompt version will be created if the provided details are new.
776
+
777
+
</dd>
778
+
</dl>
779
+
780
+
<dl>
781
+
<dd>
782
+
783
+
**inputs:**`typing.Optional[typing.Dict[str, typing.Optional[typing.Any]]]` — The inputs passed to the prompt template.
784
+
785
+
</dd>
786
+
</dl>
787
+
788
+
<dl>
789
+
<dd>
790
+
791
+
**source:**`typing.Optional[str]` — Identifies where the model was called from.
792
+
793
+
</dd>
794
+
</dl>
795
+
796
+
<dl>
797
+
<dd>
798
+
799
+
**metadata:**`typing.Optional[typing.Dict[str, typing.Optional[typing.Any]]]` — Any additional metadata to record.
800
+
801
+
</dd>
802
+
</dl>
803
+
804
+
<dl>
805
+
<dd>
806
+
807
+
**start_time:**`typing.Optional[dt.datetime]` — When the logged event started.
808
+
809
+
</dd>
810
+
</dl>
811
+
812
+
<dl>
813
+
<dd>
814
+
815
+
**end_time:**`typing.Optional[dt.datetime]` — When the logged event ended.
816
+
817
+
</dd>
818
+
</dl>
819
+
820
+
<dl>
821
+
<dd>
822
+
823
+
**source_datapoint_id:**`typing.Optional[str]` — Unique identifier for the Datapoint that this Log is derived from. This can be used by Humanloop to associate Logs to Evaluations. If provided, Humanloop will automatically associate this Log to Evaluations that require a Log for this Datapoint-Version pair.
824
+
825
+
</dd>
826
+
</dl>
827
+
828
+
<dl>
829
+
<dd>
830
+
831
+
**trace_parent_id:**`typing.Optional[str]` — The ID of the parent Log to nest this Log under in a Trace.
832
+
833
+
</dd>
834
+
</dl>
835
+
836
+
<dl>
837
+
<dd>
838
+
839
+
**user:**`typing.Optional[str]` — End-user ID related to the Log.
840
+
841
+
</dd>
842
+
</dl>
843
+
844
+
<dl>
845
+
<dd>
846
+
847
+
**prompts_call_stream_request_environment:**`typing.Optional[str]` — The name of the Environment the Log is associated to.
848
+
849
+
</dd>
850
+
</dl>
851
+
852
+
<dl>
853
+
<dd>
854
+
855
+
**save:**`typing.Optional[bool]` — Whether the request/response payloads will be stored on Humanloop.
856
+
857
+
</dd>
858
+
</dl>
859
+
860
+
<dl>
861
+
<dd>
862
+
863
+
**log_id:**`typing.Optional[str]` — This will identify a Log. If you don't provide a Log ID, Humanloop will generate one for you.
864
+
865
+
</dd>
866
+
</dl>
867
+
868
+
<dl>
869
+
<dd>
870
+
871
+
**provider_api_keys:**`typing.Optional[ProviderApiKeysParams]` — API keys required by each provider to make API calls. The API keys provided here are not stored by Humanloop. If not specified here, Humanloop will fall back to the key saved to your organization.
872
+
873
+
</dd>
874
+
</dl>
875
+
876
+
<dl>
877
+
<dd>
878
+
879
+
**num_samples:**`typing.Optional[int]` — The number of generations.
880
+
881
+
</dd>
882
+
</dl>
883
+
884
+
<dl>
885
+
<dd>
886
+
887
+
**return_inputs:**`typing.Optional[bool]` — Whether to return the inputs in the response. If false, the response will contain an empty dictionary under inputs. This is useful for reducing the size of the response. Defaults to true.
888
+
889
+
</dd>
890
+
</dl>
891
+
892
+
<dl>
893
+
<dd>
894
+
895
+
**logprobs:**`typing.Optional[int]` — Include the log probabilities of the top n tokens in the provider_response
896
+
897
+
</dd>
898
+
</dl>
899
+
900
+
<dl>
901
+
<dd>
902
+
903
+
**suffix:**`typing.Optional[str]` — The suffix that comes after a completion of inserted text. Useful for completions that act like inserts.
![fern-api[bot]](https://avatars.githubusercontent.com/in/244756?v=4&size=40){kind=avatar}
0 commit comments