Skip to content Skip to sidebar Skip to footer
Showing posts with the label Dask
Parallelize Tree Creation With Dask

Parallelize Tree Creation With Dask

Post a Comment
I need help about a problem that I'm pretty sure dask can solve. But I don't know how to ta… Read more Parallelize Tree Creation With Dask
Applying A Function Along An Axis Of A Dask Array

Applying A Function Along An Axis Of A Dask Array

Post a Comment
I'm analyzing ocean temperature data from a climate model simulation where the 4D data arrays (… Read more Applying A Function Along An Axis Of A Dask Array
Randomly Mask/set Nan X% Of Data Points In Huge Xarray.dataarray

Randomly Mask/set Nan X% Of Data Points In Huge Xarray.dataarray

Post a Comment
I have a huge (~ 2 billion data points) xarray.DataArray. I would like to randomly delete (either m… Read more Randomly Mask/set Nan X% Of Data Points In Huge Xarray.dataarray
With Xarray, How To Parallelize 1d Operations On A Multidimensional Dataset?

With Xarray, How To Parallelize 1d Operations On A Multidimensional Dataset?

Post a Comment
I have a 4D xarray Dataset. I want to carry out a linear regression between two variables on a spec… Read more With Xarray, How To Parallelize 1d Operations On A Multidimensional Dataset?
Xarray.open_mfdataset() Doesn't Work If Dask.distributed Client Has Been Created

Xarray.open_mfdataset() Doesn't Work If Dask.distributed Client Has Been Created

Post a Comment
I have a bit of a weird problem that I'd appreciate some input on. Basically, I'm running a… Read more Xarray.open_mfdataset() Doesn't Work If Dask.distributed Client Has Been Created
Dask With Htcondor Scheduler

Dask With Htcondor Scheduler

Post a Comment
Background I have an image analysis pipeline with parallelised steps. The pipeline is in python and… Read more Dask With Htcondor Scheduler