In Pyspark Is There Any Way To Dynamically Register Udf Using Functions Of Python Class Given At Run Time?

I am new to Python, so apologizing if there is any mistake in my approach I have a scenario where client can provide its custom Python functions and wants to register them as UDF i

Solution 1:

As highlighted by user10938362 the issue was on system configuration side & not on code side

After setting PYSPARK_PYTHON in PyDev interpreter of eclipse, code executed successfully

PYSPARK_PYTHON = C:\Users\User\anaconda3\python.exe