Skip to content Skip to sidebar Skip to footer
Showing posts with the label Dask
Parallelize Tree Creation With Dask

Parallelize Tree Creation With Dask

Post a Comment
I need help about a problem that I'm pretty sure dask can solve. But I don't know how to ta… Read more Parallelize Tree Creation With Dask
Applying A Function Along An Axis Of A Dask Array

Applying A Function Along An Axis Of A Dask Array

Post a Comment
I'm analyzing ocean temperature data from a climate model simulation where the 4D data arrays (… Read more Applying A Function Along An Axis Of A Dask Array
Randomly Mask/set Nan X% Of Data Points In Huge Xarray.dataarray

Randomly Mask/set Nan X% Of Data Points In Huge Xarray.dataarray

Post a Comment
I have a huge (~ 2 billion data points) xarray.DataArray. I would like to randomly delete (either m… Read more Randomly Mask/set Nan X% Of Data Points In Huge Xarray.dataarray
With Xarray, How To Parallelize 1d Operations On A Multidimensional Dataset?

With Xarray, How To Parallelize 1d Operations On A Multidimensional Dataset?

Post a Comment
I have a 4D xarray Dataset. I want to carry out a linear regression between two variables on a spec… Read more With Xarray, How To Parallelize 1d Operations On A Multidimensional Dataset?
Xarray.open_mfdataset() Doesn't Work If Dask.distributed Client Has Been Created

Xarray.open_mfdataset() Doesn't Work If Dask.distributed Client Has Been Created

Post a Comment
I have a bit of a weird problem that I'd appreciate some input on. Basically, I'm running a… Read more Xarray.open_mfdataset() Doesn't Work If Dask.distributed Client Has Been Created
Dask With Htcondor Scheduler

Dask With Htcondor Scheduler

Post a Comment
Background I have an image analysis pipeline with parallelised steps. The pipeline is in python and… Read more Dask With Htcondor Scheduler
Dask Broadcast Not Available During Compute Graph

Dask Broadcast Not Available During Compute Graph

Post a Comment
I am experimenting with Dask and want to ship a lookup pandas.DataFrame to all worker nodes. Unfort… Read more Dask Broadcast Not Available During Compute Graph
Reshape A Dask Array (obtained From A Dask Dataframe Column)

Reshape A Dask Array (obtained From A Dask Dataframe Column)

Post a Comment
I am new to dask and am trying to figure out how to reshape a dask array that I've obtained fro… Read more Reshape A Dask Array (obtained From A Dask Dataframe Column)