Skip to content

docs(no-code): native Langflow tracing (TH-8224) - #1012

Merged
nik13 merged 6 commits into
mainfrom
feat/th-8224-langflow-docs
Nov 9, 2026
Merged

nik13 merged 6 commits into
mainfrom
feat/th-8224-langflow-docs

Conversation

@nik13

@nik13 nik13 commented Oct 17, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Replace the unreleased Langflow source-fork recipe with the released native integration:

  • langflow==1.13.1 + traceloop-sdk==0.63.0, configured through Langflow's built-in Traceloop tracer.
  • Native OTLP/HTTP endpoint, percent-encoded Future AGI auth headers, and standard project_name / project_type resource attributes. No fork, copied instrumentation, custom component, or second instrumentor.
  • Concise setup and a text-only OpenAI-compatible Basic Prompting example. No internal QA diary on the customer page.
  • Explicit limitations: model calls are separate traces, component content is not hidden by the SDK content switch, error events may contain stack traces, component classification and session mapping differ from the old fork.
  • Remove the false claim that Future AGI rejects gzip. Do not replace it with a claim of newly qualified compressed Cloud ingestion: this qualification captured gzip locally and forwarded decoded protobuf to Cloud.
  • Update the integration catalog to Native OTLP; preserve all existing catalog entries when merging current main.
  • Add five public-contract regression tests and include them in the normal integration test command.

Changed page: /docs/integrations/no-code/langflow.

Why native, not a fork

Langflow's released Traceloop integration already supports custom endpoints and headers, as documented in its native Traceloop guide. Its general OpenTelemetry export is a different service-health path and deliberately excludes LLM content. The page keeps that distinction explicit.

A source-only fork is not necessary customer guidance for this scope. future-agi/langflow#1 now recommends closure after this guide lands. It has not been closed or merged. The existing upstream langflow-ai/langflow#7670 was reviewed read-only and reconciled in the fork PR body; no upstream write or new upstream PR was made.

Live qualification

E2B run lf1012-native-r4-1109, exit 0. Python 3.12.16; Langflow / langflow-base / lfx 1.13.1; traceloop-sdk 0.63.0; opentelemetry-sdk 1.45.2; OpenAI SDK 2.54.0. Sandbox deleted and confirmed unavailable afterwards.

  1. Installed the published packages into a fresh environment using the guide's install commands and executed its configuration block with placeholder Future AGI credentials. The destination/project/auth values were replaced with loopback test values for collection, with gzip enabled for the wire check. The disposable server used loopback-only access and synthetic data. No Future AGI Cloud key entered E2B.
  2. Started the released langflow run --host 127.0.0.1 --port 7860; /health returned 200. Imported the released Basic Prompting starter flow through the API.
  3. Configured the native OpenAI Compatible provider for https://openrouter.ai/api/v1, using the actual OpenRouter key only through one-run credential staging. Approved only https://openrouter.ai for this server-provisioned credential.
  4. One real non-streaming openai/gpt-4.1-nano completion answered 391; the Langflow run endpoint returned 200.
  5. Captured six OTLP protobuf bodies at /tracer/v1/traces, both Future AGI headers present, project_name=th8103-docs, project_type=observe. Requests used gzip; the loopback collector decoded them before inspection.
  6. Compared each captured body against the actual provider key in-process: absent. Removed the staged local credential immediately after the sandbox run.
  7. Forwarded the six decoded protobuf bodies locally using the approved Cloud forwarding helper: 6/6 HTTP 200 responses in project th8103-docs.
Native trace ID Captured result
Flow + components 7766e0ed47d7149f1aee5de4ea8cdbd0 One run root and four component children: Chat Input, Prompt Template, Language Model, Chat Output
Model, separate root 5116c136f07737f21614549f58744504 ChatOpenAI.chat, input and output messages, model name, 33 input / 2 output tokens

Cloud HTTP acceptance is recorded precisely; no Cloud storage readback, browser check, or screenshot is claimed. The customer page does not promise a joined flow/model trace or the fork's redaction controls.

Qualification iterations

  • lf1012-native-r1-1109: a harness edit introduced an unbound prompt variable; fixed to a constant system prompt. No model call.
  • lf1012-native-r2-1109: harness supplied scalar overrides without a built-in model selection; corrected to Langflow's native model selection object. No model call.
  • lf1012-native-r3-1109: Langflow correctly rejected a server credential at an unapproved custom endpoint; explicitly approved the intended OpenRouter destination. No model call.
  • lf1012-native-r4-1109: successful real call and native export described above.

Documentation validation

  • lf1012-docs-r1-1109: 278 integration tests passed; zero broken navigation/content links; integration type check passed. Full build reached the sandbox's default 2 GiB JavaScript heap limit, so it was rerun with a 6 GiB heap in the same 8 GiB E2B class.
  • lf1012-docs-r2-1109: exit 0, 278/278 integration tests (including five new Langflow contracts), zero broken navigation/content links, explicit integration TypeScript check, full Astro build and Pagefind passed. All four staged changed files were checked byte-for-byte against the pushed source. The rendered HTML was inspected: correct title/headings, three rendered shell blocks, no browser driven. Sandbox deleted and confirmed unavailable afterwards.
  • GitHub PR checks for head fe5b47bd86396bcde87b2baa5f7969fae8ab5a4e: 8/8 passed. PR Checks includes links/redirects, both Helicone conformance matrices, docs build/Pagefind and built-site integration browser regression checks; FastMCP native examples and Temporal Go native tracing both passed their two matrices.

E2E coverage and self-review

Not applicable (no e2e/ harness) · flows hit: n/a · marker: n/a · verdict: not applicable. Native Langflow qualification is recorded separately above, not presented as a product E2E-harness result.

Reviewed the actual final four-file diff against the resolved PR base, including the whitespace-insensitive diff, native source behavior and runtime evidence. Applied the internal minimal-code, PR-review and testing standards. No new blocking findings. There are no application migrations, API contracts or OSS/EE boundary changes. Page-contract tests protect the public setup; the real provider call and Cloud acceptance are qualification evidence, not proof of every Langflow feature.

Merge and publication state

Merged origin/main at ddca13930bd9c4b9cc80384b7cf2b1a0d71fa43d through merge commit f876a1e1, retaining all catalog entries. Pushed to the existing feat/th-8224-langflow-docs branch without rebase, force-push, or branch rename. PR is not a draft, is conflict-free, and is 0 commits behind that base. All eight checks are complete and green. GitHub still reports REVIEW_REQUIRED: a non-author approval and the user's merge remain outstanding. Nothing has been merged or published to the docs site by this pass.

Linear: TH-8224 (parent TH-8103).

🤖 Generated with Claude Code

New page for the Future AGI tracer in the future-agi/langflow fork:
install, environment variables, what Observe shows, privacy default and
hide switches, errors and failure behaviour, tested versions (Langflow
1.12.6, 1.12.4 and the release-1.13.0 candidate), how it differs from
the Phoenix/Traceloop tracers and traceAI LangChain, limits and
troubleshooting. No navigation change; the nav PR adds it.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…(TH-8224)

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@nik13
nik13 marked this pull request as ready for review October 21, 2026 22:35
nik13 and others added 2 commits October 29, 2026 06:10
Co-Authored-By: Claude Code <noreply@anthropic.com>
Co-Authored-By: Claude Code <noreply@anthropic.com>
nik13 and others added 2 commits November 8, 2026 17:19
Preserve all current integration catalog entries.

Co-Authored-By: Claude Code <noreply@anthropic.com>
Replace the source-fork recipe with native OTLP configuration qualified on released Langflow 1.13.1. State separate model traces and component-content privacy limits, and add public setup regressions.

Co-Authored-By: Claude Code <noreply@anthropic.com>
@nik13 nik13 changed the title docs(no-code): Langflow tracing (TH-8224) docs(no-code): native Langflow tracing (TH-8224) Nov 9, 2026
@nik13
nik13 merged commit 5e54cbc into main Nov 9, 2026
8 checks passed
@nik13
nik13 deleted the feat/th-8224-langflow-docs branch November 9, 2026 04:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant