Stream volume file uploads and downloads instead of buffering in memory

[mishushakov]

Follow-up to #1433. Builds on the shared streaming infrastructure introduced there (FILE_TIMEOUT_MS, request-controller/stream-cleanup helpers in connectionConfig, io_utils chunk iterators, the runtime guard) and applies the same streaming model to volumes.

Note

Based on mishushakov/stream-write-file-upload (#1433). Merge that PR first; this PR's diff will then retarget to main automatically.

What changed

• Volume.writeFile() / Volume.write_file() — stream the request body instead of buffering it in memory.
  • JS: ReadableStream data is streamed outside the browser (half-duplex); browsers still buffer since they can't stream request bodies.
  • Python: file-like objects are streamed in chunks (async wraps them in an async iterator; sync passes them to httpx directly, text-mode IO is encoded chunk-by-chunk).
• Volume.readFile(format="stream") / read_file(format="stream") — the request timeout now bounds only the initial handshake, not the body read, matching the sandbox files.read stream path. A dropped connection during the handshake surfaces the same typed, health-checked error; JS supports signal to cancel an in-flight stream and cancels unconsumed bodies on error so the pooled connection is released.

Usage

JS — stream a file straight to a volume without buffering:

import { createReadStream } from 'node:fs'
import { Readable } from 'node:stream'

const stream = Readable.toWeb(createReadStream('large-input.bin'))
await volume.writeFile('/data/large-input.bin', stream)

// read back as a stream; the body lives until consumed/cancelled
const out = await volume.readFile('/data/large-input.bin', { format: 'stream' })
for await (const chunk of out) {
  // process chunk
}

Python — stream a file-like object:

with open("large-input.bin", "rb") as f:
    volume.write_file("/data/large-input.bin", f)  # streamed, not read() into memory

for chunk in volume.read_file("/data/large-input.bin", format="stream"):
    ...  # process chunk

Testing

• pnpm run format, pnpm run lint, pnpm run typecheck pass.
• Added volume streaming tests (JS tests/volume/file.test.ts; Python sync/async test_file.py text-stream cases).

🤖 Generated with Claude Code

[chatgpt-codex-connector]

Codex usage limits have been reached for code reviews. Please check with the admins of this repo to increase the limits by adding credits.
Credits must be used to enable repository wide code reviews.

[changeset-bot]

🦋 Changeset detected

Latest commit: 90ae65f

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 2 packages

Name	Type
e2b	Patch
@e2b/python-sdk	Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

[cursor]

PR Summary

Medium Risk
Streaming volume I/O changes timeout and connection behavior for large transfers; duplicate tests are a hygiene issue only.

Overview
Volume file I/O in JS and Python now streams uploads and downloads with handshake-only timeouts, idle read bounds, and renamed option types with deprecated aliases.

packages/js-sdk/tests/sandbox/files/read.test.ts accidentally duplicates three sandboxTest blocks (read file as stream, read non-existing file as stream, read empty file in all formats); the same cases already exist earlier in the file and should not be added twice.

^{Reviewed by Cursor Bugbot for commit 90ae65f. Bugbot is set up for automated code reviews on this repo. Configure here.}

[github-actions]

Package Artifacts

Built from 859bb7b. Download artifacts from this workflow run.

JS SDK (e2b@2.30.5-mishushakov-stream-write-volumes.0):

npm install ./e2b-2.30.5-mishushakov-stream-write-volumes.0.tgz

CLI (@e2b/cli@2.12.3-mishushakov-stream-write-volumes.0):

npm install ./e2b-cli-2.12.3-mishushakov-stream-write-volumes.0.tgz

Python SDK (e2b==2.29.4+mishushakov-stream-write-volumes):

pip install ./e2b-2.29.4+mishushakov.stream.write.volumes-py3-none-any.whl

[chatgpt-codex-connector]

Codex usage limits have been reached for code reviews. Please check with the admins of this repo to increase the limits by adding credits.
Credits must be used to enable repository wide code reviews.

[matthewlouisbrockman]

hmm, don't think there's timeouts on this is there?

[cursor]

Cursor Bugbot has reviewed your changes and found 2 potential issues.

^{❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.}

Want fixes drafted automatically? Bugbot Autofix can create code changes for findings. A team admin can enable Autofix in the Cursor dashboard.

^{Reviewed by Cursor Bugbot for commit b9039a2. Configure here.}