Radiative transfer inversions are essential for extracting key information from observations of the Sun's lower atmosphere. They vary from simple analytical approximations to complex, time-consuming numerical schemes, providing a range of methods. Yet, despite notable strides in refining inversion codes in recent years, numerous challenges persist in the era of high-resolution, multi-observatory solar physics. This talk explores the limits of inversions, highlighting areas of failure and discussing necessary improvements.