Search

A general method to construct wavelet function on real number ffeld is proposed in this article,which is based on finite length sequence.This finite length sequence is called the seed sequence, and the corresponding wavelet function is called the seed sequence wavelet function.The seed sequence wavelet function is continuous and energy concentrated in both time and frequency domains,That is, it has a finite support set in both time and frequency domains. It is proved that if and only if the seed sequence has 0 mean value, the interpolation function satisfy the admissible condition of wavelet function. The conditions corresponding to the higher order vanishing moment of the seed sequence wavelet function are also given in this article. On this basis, the concept of random wavelet function is proposed, and the condition of the regularity of random wavelet is discussed.

In this paper, an orthogonal mode decomposition method is proposed to decompose ffnite length real signals on both the real and imaginary axes of the complex plane. The interpolation function space of ffnite length discrete signal is constructed, and the relationship between the dimensionality of the interpolation function space and its subspaces and the band width of the interpolation function is analyzed. It is proved that the intrinsic mode is actually the narrow band signal whose intrinsic instantaneous frequency is always positive (or always negative). Thus, the eigenmode decomposition problem is transformed into the orthogonal projection problem of interpolation function space to its low frequency subspace or narrow band subspace. Different from the existing mode decomposition methods, the orthogonal modal decomposition is a local time-frequency domain algorithm. Each operation extracts a speciffc mode. The global decomposition results obtained under the precise deffnition of eigenmodes have uniqueness and orthogonality. The computational complexity of the orthogonal mode decomposition method is also much smaller than that of the existing mode decomposition methods.

This report outlines a transformative initiative in the financial investment industry, where the conventional decision-making process, laden with labor-intensive tasks such as sifting through voluminous documents, is being reimagined. Leveraging language models, our experiments aim to automate information summarization and investment idea generation. We seek to evaluate the effectiveness of fine-tuning methods on a base model (Llama2) to achieve specific application-level goals, including providing insights into the impact of events on companies and sectors, understanding market condition relationships, generating investor-aligned investment ideas, and formatting results with stock recommendations and detailed explanations. Through state-of-the-art generative modeling techniques, the ultimate objective is to develop an AI agent prototype, liberating human investors from repetitive tasks and allowing a focus on high-level strategic thinking. The project encompasses a diverse corpus dataset, including research reports, investment memos, market news, and extensive time-series market data. We conducted three experiments applying unsupervised and supervised LoRA fine-tuning on the llama2_7b_hf_chat as the base model, as well as instruction fine-tuning on the GPT3.5 model. Statistical and human evaluations both show that the fine-tuned versions perform better in solving text modeling, summarization, reasoning, and finance domain questions, demonstrating a pivotal step towards enhancing decision-making processes in the financial domain. Code implementation for the project can be found on GitHub: https://github.com/Firenze11/finance_lm.

ChatGPT is phenomenal. However, it is prohibitively expensive to train and refine such giant models. Fortunately, small language models are flourishing and becoming more and more competent. We call them "mini-giants". We argue that open source community like Kaggle and mini-giants will win-win in many ways, technically, ethically and socially. In this article, we present a brief yet rich background, discuss how to attain small language models, present a comparative study of small language models and a brief discussion of evaluation methods, discuss the application scenarios where small language models are most needed in the real world, and conclude with discussion and outlook., Comment: Kaggle AI Report Competition Winner (Honorable Mention)

Interpretation and diagnosis of machine learning models have gained renewed interest in recent years with breakthroughs in new approaches. We present Manifold, a framework that utilizes visual analysis techniques to support interpretation, debugging, and comparison of machine learning models in a more transparent and interactive manner. Conventional techniques usually focus on visualizing the internal logic of a specific model type (i.e., deep neural networks), lacking the ability to extend to a more complex scenario where different model types are integrated. To this end, Manifold is designed as a generic framework that does not rely on or access the internal logic of the model and solely observes the input (i.e., instances or features) and the output (i.e., the predicted result and probability distribution). We describe the workflow of Manifold as an iterative process consisting of three major phases that are commonly involved in the model development and diagnosis process: inspection (hypothesis), explanation (reasoning), and refinement (verification). The visual components supporting these tasks include a scatterplot-based visual summary that overviews the models' outcome and a customizable tabular view that reveals feature discrimination. We demonstrate current applications of the framework on the classification and regression tasks and discuss other potential machine learning use scenarios where Manifold can be applied.