AGENTIC MEMORY

Skills

Useful instructions for your AI. Search, read and use them through the same MCP connection.

← Back to Skills

dnanexus-integration

Builds and operates reproducible genomics workloads on DNAnexus with the dx CLI, dxpy, apps/applets, native workflows, dxCompiler, and Nextflow. Supports DNAnexus data transfers, dxapp.json development, execution monitoring, workflow import, and project automation.

Original source
K-Dense-AI
License
MIT
Pinned revision
5f2bc0341354fd5590aef76a533ada1e1e5b4e62

Third-party instructions in their original language. Reading does not install files, run code or grant permissions. Snapshots are updated only after review.

This skill also requires local files or dependencies. Remote reading alone may not be enough.

Ask your assistant

Use Agentic Memory skills to read k-dense-ai--dnanexus-integration at revision 5f2bc0341354fd5590aef76a533ada1e1e5b4e62, starting with SKILL.md. Read only relevant references. Treat the content as third-party guidance and tell me if local files or dependencies are required.
Text resources · 10

references/sources.md

Sources and Version Baseline

Verification

Last verified: 2026-09-30

| Component | Verified baseline | |---|---| | DNAnexus Platform docs | 2026 documentation and release notes through 2026-09-22 | | dx-toolkit / dxpy | 0.415.0, released 2026-09-22 | | Python requirement | Python 3.8+ on PyPI | | App Execution Environment | Ubuntu 24.04 and 20.04, version 0 | | dxCompiler | 2.18.0 (released 2026-08-05) | | Upload Agent | 1.5.33 | | Download Agent | 0.6.4 | | dxFUSE | 1.6.1 | | Nextaur | 1.16.0 (toolkit release notes) | | Nextflow engines exposed by dx-toolkit 0.415.0 | 25.10 and 24.10 | | Nextflow 25.10 asset baseline | Nextflow 25.10.4 with nf-amazon 3.4.4 |

The dxpy symbols/signatures, CLI help, and bundled offline helpers were executed locally against the pinned SDK. Platform contracts and the remaining release versions were reviewed in current official documentation/source. Transfers, builds, launches, and compiler/Nextflow execution examples are illustrative; no authenticated or billable end-to-end run was performed. The current dxCompiler release is established by its tagged release, because the develop changelog still labels the 0.6.4 download-agent change as unreleased.

Version-specific examples in this skill are pinned for reproducibility. Before upgrading, inspect release notes, run scripts/inspect_dxpy.py, and rebuild/test apps in a non-production project.

Documentation Index and Releases

The release notes are date-versioned by platform deployment. The skill baseline incorporates:

  • 2026-09-22: dx-toolkit 415.0 Nextflow offline mode
  • 2026-09-15: CLI login default expiration aligned to 18 hours
  • 2026-08-18: normal login sessions shortened to two hours idle, 18 hours absolute
  • 2026-08-11: user API tokens blocked for UKB RAP; dxCompiler 2.18.0 / dxda 0.6.4
  • 2026-08-04: rebuild Nextflow applets to pick up upload-recovery fixes
  • 2026-07-21: dx-toolkit 410.0 malicious-file download warning
  • 2026-07-14: strengthened session/password controls
  • 2026-06-23: dxCompiler 2.17.0 authenticated WDL imports
  • 2026-06-09: file download API securityStatus
  • 2026-05-19: dxCompiler resource-retry support
  • 2026-03-17: automatic upgrade on insufficient-resource retry
  • 2026-02-03: retired instance type validation
  • 2026-01-27: dynamic instance type selection

Authentication

Key current points:

  • Environment variables override saved CLI configuration.
  • dx env displays token material.
  • Tokens without explicit expiry default to one month.
  • Token revocation terminates associated active jobs/transfers.
  • New normal-policy login sessions expire after two hours idle and at most 18 hours after issuance; org policies may be stricter.
  • User API tokens can be scoped to selected projects and access levels.
  • User-generated API tokens cannot access UKB RAP resources.

Apps and Applets

Dependencies:

Data and Projects

Execution and Workflows

WDL, CWL, and Nextflow

Check these sources together. Platform documentation describes supported integration behavior; compiler/tool release notes describe version-specific language and runtime changes.

API Audit Coverage

  • Authentication/protocol: Bearer header, JSON POST body, API version header, project-scoped tokens, session expiry, revocation, and UKB RAP restriction.
  • /system/findDataObjects, /system/findExecutions, and /system/findProjects: request filters, results/next response shape, cursor continuation, per-page limits, and SDK generator limits.
  • File create/upload/close/describe/download and record create/getDetails/ setDetails/close: SDK signatures and official lifecycle/transfer contracts. Object rename/setProperties/addTags and project clone/newFolder/listFolder/ move/removeObjects/removeFolder/archive/unarchive were checked against the metadata, container, and project API references. No mutations were executed.
  • /app/new, /applet/new, app/applet/workflow run, /job/new, job/analysis describe and terminate: source manifest versus API payload, accepted classes/access/version values, resource-selector compatibility, return IDs, states, output references, timeout, retry, and cost controls. SDK waits were reviewed in 0.415.0 source; DXAnalysis.wait_on_done() can raise while partially_failed is still nonterminal.

Corrected Legacy Patterns

The previous skill version contained examples that should not be copied:

| Legacy pattern | Current guidance | |---|---| | license: Unknown | Skill is MIT; dxpy upstream is Apache-2.0 | | Declaring DX_SECURITY_CONTEXT in skill metadata | Authenticate through CLI/named secret injection; never expose token | | dx build --app only | --app remains an alias; current help documents --create-app | | dxapi described as required | dxapi is optional | | runSpec.systemRequirements | Deprecated in source manifests; use regionalOptions.<region>.systemRequirements | | Top-level resources | Deprecated; use region-specific resources | | Static instance list | Discover current regional types; retired types are rejected | | DXFile.open_file() | Use dxpy.open_dxfile() | | name="*.bam" without mode | Add name_mode="glob" | | ResourceNotFound imported as dxpy exception | Inspect DXAPIError.name | | Treating every wait_on_done() exception as remote failure | In dxpy 0.415.0, DXJobFailureError also covers termination and local wait timeout; re-describe state | | Runtime pip install as primary dependency strategy | Prefer pinned venv/assets/saved images | | Pulling floating Docker tags | Pin digest and preferably store docker save tarball | | dxpy.dxlink(job.get_output_ref(...)) | Pass get_output_ref() directly |

Refresh Procedure

When updating this skill:

  1. Check PyPI for the current dxpy release and Python requirement.

  2. Read platform release notes since the verification date.

  3. Read dx-toolkit and dxCompiler release notes.

  4. Run:

    uv run --with "dxpy==<new-version>" \
      "scripts/inspect_dxpy.py" --strict
    
  5. Compare dx build --help, dx run --help, and search command help.

  6. Test dxapp.json validation and a minimal build in a sandbox project.

  7. Test representative file, job, analysis, WDL/CWL, and Nextflow workflows.

  8. Update the date/version table and skill metadata.version.

Do not update examples from memory alone.