chore(deps): update dependency duckdb to v1.1.0 [security] #675
+39
−49
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR contains the following updates:
1.0.0
->1.1.0
Warning
Some dependencies could not be looked up. Check the Dependency Dashboard for more information.
GitHub Vulnerability Alerts
CVE-2024-41672
Summary
Content in filesystem is accessible for reading using
sniff_csv
, even withenable_external_access=false
.Details
During a pentest, a security researcher was able to access environment variable data and other system data by using the
sniff_csv
function, even though we setenable_external_access
to false.PoC
Impact
Provides an attacker with access to filesystem even when access is expected to be disabled and other similar functions do NOT provide access.
For example
select * from read_csv('/proc/self/environ')
fails with a permission error.There seems to be two vectors to this vulnerability:
Permission Error: Scanning CSV files is disabled through configuration
and not to provide any access to the file or even acknowledge that it exists)./etc/hosts
,proc/self/environ
, etc) even though that doesn't seem to be the intent of the sniff_csv function (my understanding is it's intending to provide information about the shape of the data, but not provide the data itself).Workaround
It is possible to work around the issue by disabling the local file system using the
disabled_filesystems
setting:will result in
Permission Error: File system LocalFileSystem has been disabled by configuration
.Fix
A fix has been merged into the
main
branch (https://github.com/duckdb/duckdb/pull/13133), and will be released with the next DuckDB release.Release Notes
duckdb/duckdb (duckdb)
v1.1.0
: DuckDB 1.1.0 "Eatoni"Compare Source
This release of DuckDB is named "Eatoni" after Eaton's pintail (Anas Eatoni) from the southern Indian Ocean.
Please also refer to the announcement blog post: https://duckdb.org/2024/09/09/announcing-duckdb-110
What's Changed
MultiFileReader
filename configurable by @lnkuiper in https://github.com/duckdb/duckdb/pull/11178feature
by @Tishj in https://github.com/duckdb/duckdb/pull/11082ROW_GROUPS_PER_FILE
for Parquet by @lnkuiper in https://github.com/duckdb/duckdb/pull/11249FileBufferType
by @lnkuiper in https://github.com/duckdb/duckdb/pull/11417schema
input argument toDuckDB.Appender
constructor by @curtd in https://github.com/duckdb/duckdb/pull/12174JEMALLOC_RETAIN
by @lnkuiper in https://github.com/duckdb/duckdb/pull/12185hive_partitioning.hpp
by @Tishj in https://github.com/duckdb/duckdb/pull/12302STANDARD_VECTOR_SIZE
andBLOCK_ALLOC_SIZE
can now be set through the Makefile by @Tishj in https://github.com/duckdb/duckdb/pull/12164DO UPDATE SET
expressions by @Tishj in https://github.com/duckdb/duckdb/pull/11866pandas_analyze_sample
setting by @Tishj in https://github.com/duckdb/duckdb/pull/11706dbgen
generate data in parallel by @Mytherin in https://github.com/duckdb/duckdb/pull/12337TIMESTAMP_MS
,TIMESTAMP_S
,TIMESTAMP_NS
fromDATE
values by @akoshchiy in https://github.com/duckdb/duckdb/pull/12352BufferHandle
inStandardBufferManager::Pin
by @lnkuiper in https://github.com/duckdb/duckdb/pull/12391RETURN_FILES
parameter toCOPY TO
by @lnkuiper in https://github.com/duckdb/duckdb/pull/12220--disable-timeout
flag by @Tishj in https://github.com/duckdb/duckdb/pull/12387$$
quotes in query strings by @lnkuiper in https://github.com/duckdb/duckdb/pull/12405duckdb_execute_prepared
by @Tishj in https://github.com/duckdb/duckdb/pull/12414AppendDefault
by @Tishj in https://github.com/duckdb/duckdb/pull/11905range
andgenerate_series
table in-out functions, and fix several issues with table in-out functions by @Mytherin in https://github.com/duckdb/duckdb/pull/12431execute
/executemany
by @Tishj in https://github.com/duckdb/duckdb/pull/12434list_value
for primitive types for significantly improved performance by @Mytherin in https://github.com/duckdb/duckdb/pull/12468PhysicalBatchCopyToFile
by @Tishj in https://github.com/duckdb/duckdb/pull/12459duckdb_create_config
by @Tishj in https://github.com/duckdb/duckdb/pull/12465ClientContext::ExecuteTaskInternal
by @Tishj in https://github.com/duckdb/duckdb/pull/12483make generate-files
if the python code generation fails by @Tishj in https://github.com/duckdb/duckdb/pull/12500EXTRACT(year/month/day FROM date/timestamp)
by @Mytherin in https://github.com/duckdb/duckdb/pull/12499datetime
andtimedelta
columns by @Tishj in https://github.com/duckdb/duckdb/pull/12519'string'
by @Tishj in https://github.com/duckdb/duckdb/pull/12511arg_min(ANY, ANY)
by @Mytherin in https://github.com/duckdb/duckdb/pull/12532histogram
function by @Mytherin in https://github.com/duckdb/duckdb/pull/12538DO NOTHING
by @Tishj in https://github.com/duckdb/duckdb/pull/12554equi_width_bins
function to compute histogram boundaries by @Mytherin in https://github.com/duckdb/duckdb/pull/12574np.nan
, deprecated alias starting with NumPy 2.0 by @Tishj in https://github.com/duckdb/duckdb/pull/12583bind_expression
callback to scalar function, and use it to turntypeof
into aBoundConstantExpression
by @Mytherin in https://github.com/duckdb/duckdb/pull/12580can_cast_implicitly
scalar function by @Mytherin in https://github.com/duckdb/duckdb/pull/12581histogram
andhistogram_values
table macro, and add support for default table macros (similar to how we support default macros) by @Mytherin in https://github.com/duckdb/duckdb/pull/12590table_description
struct to query various information about the table. by @Tishj in https://github.com/duckdb/duckdb/pull/12460.benchmark
files by @maiadegraaf in https://github.com/duckdb/duckdb/pull/12598OwningStringMap
- and reworkhistogram
andmode
functions to use this by @Mytherin in https://github.com/duckdb/duckdb/pull/12601mode
aggregate by @Mytherin in https://github.com/duckdb/duckdb/pull/12619quantile
aggregate - clean up code & supportquantile_disc
/median
for all types by @Mytherin in https://github.com/duckdb/duckdb/pull/12630histogram_exact
function that adds values to bins only if they match exactly, and addother
column that contains values that do not fit in any bin by @Mytherin in https://github.com/duckdb/duckdb/pull/12650approx_top_k
aggregate based on the (Filtered) Space-Saving algorithm, and use it in histogram by @Mytherin in https://github.com/duckdb/duckdb/pull/12653std::string
inlist
aggregate - and use more efficientmemcpy
for batched copy by @Mytherin in https://github.com/duckdb/duckdb/pull/12694Configuration
📅 Schedule: Branch creation - "" (UTC), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about this update again.
This PR was generated by Mend Renovate. View the repository job log.