Category "dataframe"

pyspark get element from array Column of struct based on condition

I have a spark df with the following schema: |-- col1 : string |-- col2 : string |-- customer: struct | |-- smt: string | |-- attributes: array (null

pandas combine two columns with null values

I have a df with two columns and I want to combine both columns ignoring the NaN values. The catch is that sometimes both columns have NaN values in which case

Set MultiIndex of an existing DataFrame in pandas

I have a DataFrame that looks like Emp1 Empl2 date Company 0 0 0 2012-05-01 apple 1 0 1 2012-05-29

check if pair of values is in pair of columns in pandas

Basically, I have latitude and longitude (on a grid) in two different columns. I am getting fed two-element lists (could be numpy arrays) of a new coordinate se

How to remove the border of Pandas dataframe?

When I use pandas dataframe to excel, the border of the header will be generated automatically. When I use styleframe to excel, the border of the whole table wi

R - "Error in file(file, ifelse(append, "a", "w")) : cannot open the connection"

I have a data frame of this form: X1 X2 X3 X4 R290601 WOVEN TWILL 001 6

Is there a way to reorder a dataframe's column using a user defined list?

Hi there heroes! I'm currently working on a project where I have to process 2D arrays using pandas (numpy is out of question in the context for reasons I can't

pandas_ta parabolic SAR giving wrong values for yfinance

I made a function that uses the psar function from the pandas_ta library. This function seems to work incorrectly, it gives the PSARl, PSARs and PSARr values on

Pretty Printing a pandas dataframe

How can I print a pandas dataframe as a nice text-based table, like the following? +------------+---------+-------------+ | column_one | col_two | column_3

Pandas split column into multiple columns by comma

I am trying to split a column into multiple columns based on comma/space separation. My dataframe currently looks like KEYS

Preserve Dataframe column data type after outer merge

When you merge two indexed dataframes on certain values using 'outer' merge, python/pandas automatically adds Null (NaN) values to the fields it could not match

How can I map True/False to 1/0 in a Pandas DataFrame?

I have a column in python pandas DataFrame that has boolean True/False values, but for further calculations I need 1/0 representation. Is there a quick pandas/n

Convert DataFrame column type from string to datetime

How can I convert a DataFrame column of strings (in dd/mm/yyyy format) to datetimes?

How do I select rows from a DataFrame based on column values?

How can I select rows from a DataFrame based on values in some column in Pandas? In SQL, I would use: SELECT * FROM table WHERE column_name = some_value