-
Notifications
You must be signed in to change notification settings - Fork 352
All issues
Issue creation is restricted in this repository
Issues
is:issue state:open
is:issue state:open
Search results
Native shuffle fails with a 2GB task serialization OOM on jobs with very many partitions
bugSomething isn't workingSomething isn't workingStatus: Open.#5391 In apache/datafusion-comet;- Status: Open.#5390 In apache/datafusion-comet;
- Status: Open.#5389 In apache/datafusion-comet;
Extend native Arrow UDF path to scalar Python UDFs (ArrowEvalPythonExec)
enhancementNew feature or requestNew feature or requestStatus: Open.#5386 In apache/datafusion-comet;- Status: Open.#5385 In apache/datafusion-comet;
Reduce JNI round-trips in the unified memory pools (batching, hysteresis, cheaper call path)
area:ffiArrow FFI / JNI boundaryArrow FFI / JNI boundaryenhancementNew feature or requestNew feature or requestpriority:mediumFunctional bugs, performance regressions, broken featuresFunctional bugs, performance regressions, broken featuresStatus: Open.#5383 In apache/datafusion-comet;Report native child-operator spill metrics in Spark task metrics for unified shuffle plans
area:shuffleShuffle (JVM and native)Shuffle (JVM and native)bugSomething isn't workingSomething isn't workingenhancementNew feature or requestNew feature or requestpriority:mediumFunctional bugs, performance regressions, broken featuresFunctional bugs, performance regressions, broken featuresStatus: Open.Make native contrib scan dispatch generic (remove per-contrib arms from core Rust)
area:scanParquet scan / data readingParquet scan / data readingenhancementNew feature or requestNew feature or requestStatus: Open.#5379 In apache/datafusion-comet;Move contrib scan proto messages out of core operator.proto into contrib/<name>/proto
area:scanParquet scan / data readingParquet scan / data readingenhancementNew feature or requestNew feature or requestStatus: Open.#5378 In apache/datafusion-comet;Use end to end microbenchmarks to prevent performance regressions between releases
area:ciCI/CD, GitHub Actions, build toolingCI/CD, GitHub Actions, build toolingenhancementNew feature or requestNew feature or requestStatus: Open.Nine expression benchmark rows labelled "Comet" are measuring Spark
area:expressionsExpression evaluationExpression evaluationbugSomething isn't workingSomething isn't workingpriority:lowMinor issues, test failures, tooling, cosmeticMinor issues, test failures, tooling, cosmetictestTesting relatedTesting relatedStatus: Open.to_time / try_to_time: native parser rejects 'T12' and '12:30:45.' which Spark accepts
area:expressionsExpression evaluationExpression evaluationbugSomething isn't workingSomething isn't workingpriority:criticalData corruption, silent wrong results, security issuesData corruption, silent wrong results, security issuesStatus: Open.