Pivotal moments in sepsis care occur in the emergency department (ED), however, and it is unclear whether ED data is adequate to inform reinforcement learning (RL) models. We evaluated the early opportunity for the AI Clinician, a validated ICU-based RL-model, as a use case. Amongst emergency sepsis patients, model parameters were often missing and invariably measured. Current iterations of RL-models trained on ICU data face challenges in emergency sepsis care.