Skip to content

feat: datasets storage explorer, file management and stats#215

Merged
v-kessler merged 2 commits into
mainfrom
feat/datasets
Jun 24, 2026
Merged

feat: datasets storage explorer, file management and stats#215
v-kessler merged 2 commits into
mainfrom
feat/datasets

Conversation

@v-kessler

Copy link
Copy Markdown
Contributor

Summary

  • Datasets feature: dedicated tab in namespace, filtered from generic tables
  • Storage explorer with full file management (upload, download, delete, create folders)
  • Drag-and-drop move files between folders with multi-select support
  • Storage stats (file count + total size) with Pinia cache
  • Paimon file format detection (manifest→Avro, schema/snapshot→JSON, LATEST→text)
  • JSON preview via vue-json-pretty, permanent root row with select-all + URI
  • Fix delete redirect to return to datasets tab instead of tables tab
  • Fix ADLS 404 PathNotFound on empty datasets treated as empty listing

BEGIN_COMMIT_OVERRIDE
feat(ui): add Datasets feature with storage explorer enhancements
fix(ui): polish datasets file explorer and delete redirect
END_COMMIT_OVERRIDE

v-kessler and others added 2 commits June 24, 2026 19:01
- Add DatasetsList, DatasetCreate, DatasetDetail components
- Filter datasets (format=dataset) out of generic tables and tables tabs
- Add Datasets quick-link in namespace navigation tree
- Make GenericTableActionsMenu/Header/Overview entity-label aware (Dataset Settings)
- Remove recursive delete protection toggle from GenericTableOverview (moved to actions menu)
- StorageExplorer: multi-select, bulk download/delete, folder create/delete, file dates, root URI row, write mode gated on canWrite prop
- StorageExplorer: file preview for JSON (vue-json-pretty), Avro/Parquet (DuckDB), images, PDF, text
- StorageExplorer: Paimon file pattern detection (manifest-*, schema-*, snapshot-*, LATEST)
- StorageExplorer: fix ADLS 404 PathNotFound treated as empty listing
- GenericTableOverview: storage stats (file count + total size) with Pinia cache
- useStorageExplorer: ADLS 404 → empty result; GCS, S3, ADLS listing enhancements
- visual store: datasetStats cache keyed by warehouse::namespace::table

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
- Move select-all checkbox and root URI into the permanent root row
- Fix delete redirect to return to datasets tab instead of tables tab

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@coderabbitai

coderabbitai Bot commented Jun 24, 2026

Copy link
Copy Markdown

Warning

Review limit reached

@v-kessler, we couldn't start this review because you've reached your PR review rate limit.

More reviews will be available in 54 minutes and 38 seconds. Learn how PR review limits work.

Your organization has used up its prepaid credits, and credit purchases are no longer available. Enable the review add-on in the billing tab to keep reviews running — you're only billed for reviews past your plan's rate limits ($0.25/file).

⌛ How to resolve this issue?

After more reviews become available, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

To avoid repeated limits, reduce automatic review volume by pausing incremental auto-reviews earlier, using label-based review opt-in, excluding WIP or generated PR titles, or requesting reviews manually when the PR is ready. If your team needs uninterrupted high-volume reviews, an organization admin can enable usage-based credits.

🚦 How do rate limits work?

CodeRabbit enforces per-developer PR review limits for each organization. Most developers receive the normal plan review availability.

For paid Pro and Pro+ PR reviews, CodeRabbit uses adaptive limits for sustained high-volume activity. When a developer's recent PR review activity reaches the 95th percentile or higher among CodeRabbit users, additional reviews become available more gradually as earlier reviews age out of the rolling window.

Please see our Fair Usage Limits Policy for further information.

ℹ️ Review info
⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: faf9701d-9150-4475-b2d5-fa9346388bbd

📥 Commits

Reviewing files that changed from the base of the PR and between 7dac664 and b440a32.

📒 Files selected for processing (14)
  • src/components/DatasetCreate.vue
  • src/components/DatasetDetail.vue
  • src/components/DatasetsList.vue
  • src/components/GenericTableActionsMenu.vue
  • src/components/GenericTableHeader.vue
  • src/components/GenericTableOverview.vue
  • src/components/NamespaceGenericTables.vue
  • src/components/NamespaceTables.vue
  • src/components/StorageExplorer.vue
  • src/components/StorageNavigationTree.vue
  • src/components/WarehousesNavigationTree.vue
  • src/composables/useStorageExplorer.ts
  • src/index.ts
  • src/stores/visual.ts
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch feat/datasets

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@v-kessler v-kessler merged commit 0835c10 into main Jun 24, 2026
11 of 12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant