infer_datetime_format with parse_date taking more time infer_datetime_format with parse_date taking more time python-3.x python-3.x

infer_datetime_format with parse_date taking more time


What you actually want to do is add dayfirst = True

%timeit df = pd.read_csv("C:/Users/k_sego/Dates.csv", parse_dates=["Date"],dayfirst = True, infer_datetime_format=True)1.96 ms ± 115 µs per loop (mean ± std. dev. of 7 runs, 1000 loops each)

Compared to

%timeit df = pd.read_csv("C:/Users/k_sego/Dates.csv", parse_dates=["Date"])2.38 ms ± 182 µs per loop (mean ± std. dev. of 7 runs, 1000 loops each)

and

%timeit df = pd.read_csv("C:/Users/k_sego/Dates.csv", parse_dates=["Date"], infer_datetime_format=True)3.02 ms ± 670 µs per loop (mean ± std. dev. of 7 runs, 100 loops each)

The solution is to reduce the number of choices read_csv has to do things.