Skip to content

PDP-2114 Incremental write source URI support - #697

Open
rjrudin wants to merge 7 commits into
feature/archive-write-progressfrom
feature/incremental-write-source-uri
Open

rjrudin wants to merge 7 commits into
feature/archive-write-progressfrom
feature/incremental-write-source-uri

Conversation

@rjrudin

@rjrudin rjrudin commented Sep 28, 2026 •

Copy link
Copy Markdown
Contributor

Allows for storing the source URI as a metadata key on a document.

This is intended to be rebased once the feature/archive-write-progress PR is merged.

Depends on marklogic/java-client-api#1980 being merged and the Java Client being published internally first.

@rjrudin
rjrudin force-pushed the feature/incremental-write-source-uri branch from 610eb86 to 852607d Compare September 29, 2026 15:05
jonmille and others added 6 commits October 5, 2026 15:18
## Summary
Flux has CVEs flagged on `opennlp`, a transitive dependency pulled in via
`langchain4j`. Flux's shipped/runtime langchain4j version comes through this
connector's dependency declaration, not through Flux's own build file, so
the fix needs to originate here.

This PR bumps `langchain4jVersion` from `1.17.2` to `1.21.0`.

## Changes
- Updated `langchain4jVersion` in `gradle.properties` from `1.17.2` to `1.21.0`.
- `langchain4j-embeddings-all-minilm-l6-v2` remains intentionally pinned to
  `1.14.1-beta24` (see comment in `marklogic-spark-connector/build.gradle`)
  due to a GLIBC 2.29 requirement for newer betas on the CI build server.
  This is unrelated to the CVE and was left unchanged.

## Testing
- `./gradlew :marklogic-spark-connector:compileJava compileTestJava` — passes,
  no API breakage from the langchain4j upgrade.
- `./gradlew :marklogic-spark-connector:dependencies --configuration
  runtimeClasspath` — confirms `opennlp-tools` resolves to `2.5.11` (fixed
  version) with no dependency conflicts.
- `./gradlew test` (full suite, against local Docker MarkLogic instance) —
  BUILD SUCCESSFUL, all tests pass.

## Follow-up
Once this is merged and released, Flux's `connectorVersion` needs to be
bumped to pick up this change, completing the CVE remediation end-to-end
(tracked in Flux PR for MLE-29630).
MLE-33310: Update CODEOWNERS file for Dev Tools
MLE-29630: Bump langchain4j to latest version
Allows for storing the source URI as a metadata key on a document.
@rjrudin
rjrudin force-pushed the feature/incremental-write-source-uri branch from 852607d to add540e Compare October 12, 2026 13:43

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants