Yes, there are alternatives to ceftriaxone for treating bacterial infections in neonates. Cefotaxime is commonly used as it does not displace bilirubin from albumin-binding sites to the same extent as ceftriaxone. Other options include ampicillin combined with gentamicin or vancomycin depending on the type and severity of the infection.