Exploring the stability of ultra-compact anisotropic dark energy stars with maximum allowable mass in $R+\chi (R^{2}+\eta R^{3})$ gravity

In recent years, the modeling of compact astrophysical objects (COs) has garnered significant attention from various research groups, particularly in efforts to determine their stable structures. This interest has been further amplified by the incorporation of dark energy as an additional source within the relativistic interior geometries of these stellar objects. In this paper, we present new structural properties of anisotropic, static, and spherically symmetric compact stars, characterized by a two-fluid distribution comprising ordinary baryonic matter and dark energy, within the framework of the gravity theory f(R). We derive a novel class of exact analytical solutions to the modified field equations by employing the well-established Tolman–Buchdahl solutions as seed ansatz for the $$g_{tt}$$ g tt and $$g_{rr}$$ g rr metric potentials, in conjunction with a linear dark energy equation of state. The unknown parameters involved in these seed solutions, along with the dark energy coupling factor $$\omega $$ ω , are determined by a smooth matching of the interior and exterior regions in the hypersurface of the boundary. To analyze the physical viability of our model, we apply it to the compact star PSR $$J1614-2230$$ J 1614 - 2230 , using the widely studied and cosmologically consistent $$f(R)=R+\chi \Big (R^{2}+\eta R^{3}\Big )$$ f ( R ) = R + χ ( R 2 + η R 3 ) gravity model. The obtained space-time geometry is assessed on the basis of several physical constraints, including the regularity of metric components, the viability of matter variables, the validity of state parameters and energy conditions, and various stability factors. Additionally, we examine the mass-radius profile, compactness, and surface redshift to ensure the model’s physical acceptability. Notably, our analysis reveals that the maximum allowable mass and compactness of the proposed dark energy star model exceed observational data, providing strong implications within this modified gravity framework. This suggests that such a model has the potential to surpass conventional observational predictions. In conclusion, our results confirm that the proposed solutions are physically viable and realistic, effectively mimicking a stable ultra-compact dark-energy star. These findings offer new insights into the relativistic stellar framework, highlighting the intricate interplay between extended gravity theories and a two-fluid distribution.