Background: Multimodal large language models (MLLMs) have demonstrated promise on publicly available dermatology benchmarks. However, benchmark performance may not generalize to real-world dermatologic decision-making. Most prior evaluations rely on curated image-only tasks, often using dermoscopic or single-lesion or rash images obtained under standardized conditions. In contrast, real-world dermatology consultations commonly involve photographs captured in primary care or emergency department settings. Consultations are accompanied by brief requests with context written by referring clinicians; cases are reviewed by dermatologists, who triage patients for possible urgent evaluation based on likely differential diagnoses. We evaluated MLLM performance under conditions designed to reflect real-world dermatology consultation workflows.Methods: We evaluated four open-weight MLLMs (InternVL-Chat v1.5, LLaVA-Med v1.5, SkinGPT4 and MedGemma-4B-Instruct) and one commercial MLLM (GPT-4.1) across three publicly available dermatology datasets and a retrospective multi-site hospital-based dermatology consultation cohort comprising 5,811 cases and 46,405 clinical images. The real-world cohort paired clinical photographs with referring clinician consultation notes and dermatologist-authored differential diagnoses. Models were evaluated on two clinically relevant tasks: free-text differential diagnosis generation and severity-based triage of urgent dermatologic conditions. Diagnostic performance was assessed using BERTScore, LLM-based adjudication, and independent review by board-certified or board-eligible dermatologists for clinical intent, factuality, and specificity.Findings: Diagnostic performance was modest on public datasets and declined substantially in the real-world hospital consultation cohort. On public benchmarks, top-3 diagnostic accuracy reached 26.55% for the best open-weight model and 42.25% for GPT-4.1. On real-world consultation cases using images alone, top-3 diagnostic accuracy declined to 1.50-13.35% among open-weight models and 24.65% for GPT-4.1. Incorporating clinical context from referring clinician requests improved performance across all models, increasing top-3 diagnostic accuracy up to 28.75% among open-weight models and 38.93% for GPT-4.1. However, model outputs were highly sensitive to incomplete or erroneous consultation context, leading to substantial diagnostic variability across evaluation settings. For severity-based triage of dermatologic conditions, models achieved moderate sensitivity (generally exceeding 60%), suggesting potential utility for screening but insufficient reliability for clinical deployment overall.Interpretation: Current dermatology MLLMs showed lower performance under real-world consultation conditions than on public benchmark datasets. These findings suggest that limitations in visual grounding and context integration contribute substantially to current MLLM performance limitations. Future evaluation frameworks should prioritize workflow realism and deployment-oriented assessment rather than benchmark performance alone.