Magnetic properties of a spin-orbit entangled Jeff=1/2 three-dimensional frustrated rare-earth hyperkagome

The interplay between competing degrees of freedom can stabilize non-trivial magnetic states in correlated electron materials. Frustration-induced strong quantum fluctuations can evade long-range magnetic ordering leading to exotic quantum states such as spin liquids in two-dimensional spin-lattices such as triangular and kagome structures. However, the experimental realization of dynamic and correlated quantum states is rare in three-dimensional (3D) frustrated magnets wherein quantum fluctuations are less prominent. Herein, we report the crystal structure, magnetic susceptibility, electron spin resonance and specific heat studies on a 3D frustrated magnet Yb3Sc2Ga3O12. In this material, Yb3+ ions form a three-dimensional network of corner-sharing triangles known as hyperkagome lattice without any detectable anti-site disorder. Our thermodynamic results reveal a low energy state with Jeff = 1=2 degrees of freedom in the Kramers doublet state. The zero field-cooled and field cooled magnetic susceptibility taken in 0.001 T rules out the presence of spin-freezing down to 1.8 K. The Curie-Weiss fit to low temperature susceptibility data yields a small and negative Curie-Weiss temperature indicating the presence of a weak antiferromagnetic interaction between Jeff = 1=2 (Yb3+) moments. The Yb-electron spin resonance displays a broad line of non-Lorentzian shape that suggests considerable magnetic anisotropy in Yb3Sc2Ga3O12. The absence of long-range magnetic ordering inferred from specific heat data indicates a dynamic liquid-like ground state at least down to 130 mK. Furthermore, zero field specific heat shows a broad maximum around 200 mK suggesting the presence of short-range spin correlations in this three-dimensional frustrated antiferromagnet.