Background: Optimising maintenance drug treatment selection for people with bipolar disorder is challenging. There is some evidence that clinical and demographic features may predict response to lithium. However, attempts to personalise treatment choice have been limited. Method: We aimed to determine if machine learning methods applied to electronic health records could predict differential response to lithium or olanzapine. From electronic United Kingdom primary care records, we extracted a cohort of individuals prescribed either lithium (19,106 individuals) or olanzapine (12,412) monotherapy. Machine learning models were used to predict successful monotherapy maintenance treatment, using 113 clinical and demographic variables, 8,017 (41.96%) lithium responders and 3,831 (30.87%) olanzapine responders. Results: We found a quantitative structural difference in that lithium maintenance responders were weakly predictable in our holdout sample, consisting of the 5% of patients with the most recent exposure. Age at first diagnosis, age at first treatment and the time between these were the most important variables in all models. Discussion: Even if we failed to predict successful monotherapy olanzapine treatment, and so to definitively separate lithium vs. olanzapine responders, the characterization of the two groups may be used for classification by proxy. This can, in turn, be useful for establishing maintenance therapy. The further exploration of machine learning methods on EHR data for drug treatment selection could in the future play a role for clinical decision support. Signals in the data encourage further experiments with larger datasets to definitively separate lithium vs. olanzapine responders.