Skip to content

Conversation

@cristipufu
Copy link
Member

@cristipufu cristipufu commented Dec 3, 2025

Description

This PR improves streaming performance for LLM chat messages by implementing incremental markdown updates using the append() method instead of full re-renders. The key optimization reduces UI latency by only appending new content deltas during streaming rather than updating the entire message on each chunk.

  • Implemented markdown append optimization for streaming LLM responses with throttling controls
  • Added widget caching in RunDetailsPanel to avoid repeated DOM queries
  • Introduced widget pruning mechanism to prevent DOM explosion with a 20-widget limit

Development Package

  • Add this package as a dependency in your pyproject.toml:
[project]
dependencies = [
  # Exact version:
  "uipath-dev==0.0.10.dev1000230062",

  # Any version from PR
  "uipath-dev>=0.0.10.dev1000230000,<0.0.10.dev1000240000"
]

[[tool.uv.index]]
name = "testpypi"
url = "https://test.pypi.org/simple/"
publish-url = "https://test.pypi.org/legacy/"
explicit = true

[tool.uv.sources]
uipath-dev = { index = "testpypi" }

@cristipufu cristipufu self-assigned this Dec 3, 2025
@cristipufu cristipufu force-pushed the fix/textual_batch_update branch 2 times, most recently from b31a062 to fdd818c Compare December 3, 2025 11:38
@cristipufu cristipufu changed the title fix: use textual batch update for llm chunks fix: use markdown append for llm chunks Dec 3, 2025
@cristipufu cristipufu force-pushed the fix/textual_batch_update branch 6 times, most recently from dffa13d to 7f1c6d0 Compare December 3, 2025 14:10

This comment was marked as outdated.

@cristipufu cristipufu merged commit 4c9d4fd into main Dec 3, 2025
17 checks passed
@cristipufu cristipufu deleted the fix/textual_batch_update branch December 3, 2025 14:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants