Search

Modern reinforcement learning (RL) often faces an enormous state-action space. Existing analytical results are typically for settings with a small number of state-actions, or simple models such as linearly modeled Q-functions. To derive statistically efficient RL policies handling large state-action spaces, with more general Q-functions, some recent works have considered nonlinear function approximation using kernel ridge regression. In this work, we derive sample complexities for kernel based Q-learning when a generative model exists. We propose a nonparametric Q-learning algorithm which finds an $\epsilon$-optimal policy in an arbitrarily large scale discounted MDP. The sample complexity of the proposed algorithm is order optimal with respect to $\epsilon$ and the complexity of the kernel (in terms of its information gain). To the best of our knowledge, this is the first result showing a finite sample complexity under such a general model.

Non-relativistic quantum chromodynamics (NRQCD) factorization formulism is an important approach to investigate the production of the heavy quarkonium. In this paper, we study the production of the $\Omega_{ccc}$ and $\Omega_{bbb}$ at the $e^+e^-$ collider, using the NRQCD factorization formulism. We calculate the total and differential cross sections exactly of the processes, $e^+e^-\rightarrow \gamma^*/Z^*\rightarrow \Omega_{ccc}\bar{c}\bar{c}\bar{c}$ and $e^+e^-\rightarrow \gamma^*/Z^*\rightarrow \Omega_{bbb}\bar{b}\bar{b}\bar{b}$, in the leading order at the $e^+e^-$ colliders with different energies. The results show that it is hard to observe them at the $e^+e^-$ collider directly.

Deep space explorations require transferring huge amounts of data quickly from very distant targets. Laser communication is a promising technology that can offer a data rate of magnitude faster than conventional microwave communication due to the fundamentally narrow divergence of light. This study demonstrated a photon-sensitive receiver prototype with over Gigabit data rate, immunity to strong background photon noise, and simultaneous tracking ability. The advantages are inherited from a joint-optimized superconducting nanowire single-photon detector (SNSPD) array, designed into a four-quadrant structure with each quadrant capable of resolving six photons. Installed in a free-space coupled and low-vibration cryostat, the system detection efficiency reached 72.7%, the detector efficiency was 97.5%, and the total photon counting rate was 1.6 Gcps. Additionally, communication performance was tested for pulse position modulation (PPM) format. A series of signal processing methods were introduced to maximize the performance of the forward error correction (FEC) code. Consequently, the receiver exhibits a faster data rate and better sensitivity by about twofold (1.76 photons/bit at 800 Mbps and 3.40 photons/bit at 1.2 Gbps) compared to previously reported results (3.18 photon/bit at 622 Mbps for the Lunar Laser Communication Demonstration). Furthermore, communications in strong background noise and with simultaneous tracking ability were demonstrated aimed at the challenges of daylight operation and accurate tracking of dim beacon light in deep space scenarios.

Inference on the minimum clinically important difference, or MCID, is an important practical problem in medicine. The basic idea is that a treatment being statistically significant may not lead to an improvement in the patients' well-being. The MCID is defined as a threshold such that, if a diagnostic measure exceeds this threshold, then the patients are more likely to notice an improvement. Typical formulations use an underspecified model, which makes a genuine Bayesian solution out of reach. Here, for a challenging personalized MCID problem, where the practically-significant threshold depends on patients' profiles, we develop a novel generalized posterior distribution, based on a working binary quantile regression model, that can be used for estimation and inference. The advantage of this formulation is two-fold: we can theoretically control the bias of the misspecified model and it has a latent variable representation which we can leverage for efficient Gibbs sampling. To ensure that the generalized Bayes inferences achieve a level of frequentist reliability, we propose a variation on the so-called generalized posterior calibration algorithm to suitably tune the spread of our proposed posterior., Comment: Feedback welcome at https://researchers.one/articles/22.08.00008

We study the probability of Boolean functions with small max influence to become constant under random restrictions. Let $f$ be a Boolean function such that the variance of $f$ is $\Omega(1)$ and all its individual influences are bounded by $\tau$. We show that when restricting all but a $\rho=\tilde{\Omega}((\log(1/\tau))^{-1})$ fraction of the coordinates, the restricted function remains nonconstant with overwhelming probability. This bound is essentially optimal, as witnessed by the tribes function $\mathrm{TRIBES}=\mathrm{AND}_{n/C\log n}\circ\mathrm{OR}_{C\log n}$. We extend it to an anti-concentration result, showing that the restricted function has nontrivial variance with probability $1-o(1)$. This gives a sharp version of the "it ain't over till it's over" theorem due to Mossel, O'Donnell, and Oleszkiewicz. Our proof is discrete, and avoids the use of the invariance principle. We also show two consequences of our above result: (i) As a corollary, we prove that for a uniformly random input $x$, the block sensitivity of $f$ at $x$ is $\tilde{\Omega}(\log(1/\tau))$ with probability $1-o(1)$. This should be compared with the implication of Kahn, Kalai, and Linial's result, which implies that the average block sensitivity of $f$ is $\Omega(\log(1/\tau))$. (ii) Combining our proof with a well-known result due to O'Donnell, Saks, Schramm, and Servedio, one can also conclude that: Restricting all but a $\rho=\tilde\Omega(1/\sqrt{\log (1/\tau) })$ fraction of the coordinates of a monotone function $f$, then the restricted function has decision tree complexity $\Omega(\tau^{-\Theta(\rho)})$ with probability $\Omega(1)$., Comment: 31 pages

We investigate the steady-state and dynamical properties of a reciprocal many-body system consisting of self-propelled active particles with local alignment interactions that exists within a fan-shaped neighborhood of each particle. We find that the nonreciprocity can emerge in this reciprocal system once the spontaneous symmetry breaking is present, and the effective description of the system assumes a non-Hermitian structure that directly originates from the emergent nonreciprocity. This emergent nonreciprocity can impose strong influences on the properties the system. In particular, it can even drive a real-space condensation of active particles. Our findings pave the way for identifying a new class of physics in reciprocal systems that is driven by the emergent nonreciprocity., Comment: 6+1 pages, 3+1 figures

Energy carrier evolution is crucial for material performance. Ultrafast microscopy has been widely applied to visualize the spatiotemporal evolution of energy carriers. However, direct imaging of small amounts of energy carriers on nanoscale remains difficult due to extremely weak transient signals. Here we present a method for ultrasensitive and high-throughput imaging of energy carrier evolution in space and time. This method combines femtosecond pump-probe techniques with interferometric scattering microscopy (iSCAT), named Femto-iSCAT. The interferometric principle and unique spatially-modulated contrast enhancement increase the transient image contrast by >2 orders of magnitude and enable the exploration of new science. We address three important and challenging problems: transport of different energy carriers at various interfaces, heterogeneous hot electron distribution and relaxation in single plasmonic resonators, and distinct structure-dependent edge state dynamics of carriers and excitons in optoelectronic semiconductors. Femto-iSCAT holds great potential as a universal tool for ultrasensitive imaging of energy carrier evolution in space and time.

Nonequilibrium many-body transient dynamics play an important role in the adaptation of active matter systems environment changes. However, the generic universal behavior of such dynamics is usually elusive and left as open questions. Here, we investigate the transient dynamics of vortex-like states in a two-dimensional active matter system that consists of self-propelled particles with alignment interactions subjected to extrinsic environmental noise. We identify a universal power-law scaling for the average lifetime of vortex-like states with respect to the speed of the self-propelled particles. This universal scaling behavior manifests strong robustness against the noise, up to the level where influences from environmental fluctuations are large enough to directly randomize the moving directions of particles. Direct experimental observations can be readily performed by related experimental setups operated at a decently low noise level., Comment: 5 pages, 3 figures