-
MMSci: A Multimodal Multi-Discipline Dataset for PhD-Level Scientific Comprehension
Authors:
Zekun Li,
Xianjun Yang,
Kyuri Choi,
Wanrong Zhu,
Ryan Hsieh,
HyeonJung Kim,
Jin Hyuk Lim,
Sungyoung Ji,
Byungju Lee,
Xifeng Yan,
Linda Ruth Petzold,
Stephen D. Wilson,
Woosang Lim,
William Yang Wang
Abstract:
The rapid advancement of Large Language Models (LLMs) and Large Multimodal Models (LMMs) has heightened the demand for AI-based scientific assistants capable of understanding scientific articles and figures. Despite progress, there remains a significant gap in evaluating models' comprehension of professional, graduate-level, and even PhD-level scientific content. Current datasets and benchmarks pr…
▽ More
The rapid advancement of Large Language Models (LLMs) and Large Multimodal Models (LMMs) has heightened the demand for AI-based scientific assistants capable of understanding scientific articles and figures. Despite progress, there remains a significant gap in evaluating models' comprehension of professional, graduate-level, and even PhD-level scientific content. Current datasets and benchmarks primarily focus on relatively simple scientific tasks and figures, lacking comprehensive assessments across diverse advanced scientific disciplines. To bridge this gap, we collected a multimodal, multidisciplinary dataset from open-access scientific articles published in Nature Communications journals. This dataset spans 72 scientific disciplines, ensuring both diversity and quality. We created benchmarks with various tasks and settings to comprehensively evaluate LMMs' capabilities in understanding scientific figures and content. Our evaluation revealed that these tasks are highly challenging: many open-source models struggled significantly, and even GPT-4V and GPT-4o faced difficulties. We also explored using our dataset as training resources by constructing visual instruction-following data, enabling the 7B LLaVA model to achieve performance comparable to GPT-4V/o on our benchmark. Additionally, we investigated the use of our interleaved article texts and figure images for pre-training LMMs, resulting in improvements on the material generation task. The source dataset, including articles, figures, constructed benchmarks, and visual instruction-following data, is open-sourced.
△ Less
Submitted 5 July, 2024;
originally announced July 2024.
-
A Study of Dirac Fermionic Dark Matters
Authors:
Chun-Khiang Chua,
Ron-Chou Hsieh
Abstract:
We study pure weak eigenstate Dirac fermionic dark matters (DM). We consider WIMP with renormalizable interaction. According to results of direct searches and the nature of DM (electrical neutral and being a pure weak eigenstate), the quantum number of DM is determined to be $I_3=Y=0$. There are only two possible cases: either DM has non-vanishing weak isospin ($I\neq 0$) or it is an isosinglet (I…
▽ More
We study pure weak eigenstate Dirac fermionic dark matters (DM). We consider WIMP with renormalizable interaction. According to results of direct searches and the nature of DM (electrical neutral and being a pure weak eigenstate), the quantum number of DM is determined to be $I_3=Y=0$. There are only two possible cases: either DM has non-vanishing weak isospin ($I\neq 0$) or it is an isosinglet (I=0). In the first case, the Sommerfeld enhancement is sizable for large $I$, producing large $χ^0\bar{χ^0}\to VV$ rates. In particular, we obtain large $χ\barχ\to W^+ W^-$ cross section, which is comparable to the latest bounds from indirect searches and $m_χ$ is constrained to be larger than few hundred GeV to few TeV. It is possible to give correct relic density with $m_χ$ higher than these lower bounds. In the second case, to couple DM to standard model (SM) particles, a SM-singlet vector mediator $X$ is required from renormalizability and the SM gauge quantum numbers. To satisfy the latest bounds of direct searches and to reproduce the DM relic density at the same time, resonant enhancement in DM annihilation diagram is needed. Thus, the masses of DM and the mediator are related. Furthermore, this model is not sufficient to explain the deviation in muon $g-2$.
△ Less
Submitted 12 August, 2013; v1 submitted 30 May, 2013;
originally announced May 2013.
-
Mobile P2P Trusted On-Demand Video Streaming
Authors:
Thava Iyer,
Robert Hsieh,
Nikzad Babaii Rizvandi,
Benoy Varghese,
Roksana Boreli
Abstract:
We propose to demonstrate a mobile server assisted P2P system for on-demand video streaming. Our proposed solution uses a combination of 3G and ad-hoc Wi-Fi connections, to enable mobile devices to download content from a centralised server in a way that minimises the 3G bandwidth use and cost. On the customised GUI, we show the corresponding reduction in 3G bandwidth achieved by increasing the nu…
▽ More
We propose to demonstrate a mobile server assisted P2P system for on-demand video streaming. Our proposed solution uses a combination of 3G and ad-hoc Wi-Fi connections, to enable mobile devices to download content from a centralised server in a way that minimises the 3G bandwidth use and cost. On the customised GUI, we show the corresponding reduction in 3G bandwidth achieved by increasing the number of participating mobile devices in the combined P2P and ad-hoc Wi- Fi network, while demonstrating the good video playout quality on each of the mobiles. We also demonstrate the implemented trust mechanism which enables mobiles to only use trusted adhoc connections. The system has been implemented on Android based smartphones.
△ Less
Submitted 31 March, 2012;
originally announced April 2012.
-
Nonlocal Condensate Model for QCD Sum Rules
Authors:
Ron-Chou Hsieh,
Hsiang-nan Li
Abstract:
We include effects of nonlocal quark condensates into QCD sum rules (QSR) via the K$\ddot{\mathrm{a}}$ll$\acute{\mathrm{e}}$n-Lehmann representation for a dressed fermion propagator, in which a negative spectral density function manifests their nonperturbative nature. Applying our formalism to the pion form factor as an example, QSR results are in good agreement with data for momentum transfer squ…
▽ More
We include effects of nonlocal quark condensates into QCD sum rules (QSR) via the K$\ddot{\mathrm{a}}$ll$\acute{\mathrm{e}}$n-Lehmann representation for a dressed fermion propagator, in which a negative spectral density function manifests their nonperturbative nature. Applying our formalism to the pion form factor as an example, QSR results are in good agreement with data for momentum transfer squared up to $Q^2 \approx 10 $ GeV$^2$. It is observed that the nonlocal quark condensate contribution descends like $1/Q^2$, different from the exponential decrease in $Q^2$ obtained in the literature, and contrary to the linear rise in the local-condensate approximation.
△ Less
Submitted 16 March, 2011; v1 submitted 25 September, 2009;
originally announced September 2009.
-
Transition to perturbative QCD in two-photon collisions
Authors:
Ron-Chou Hsieh,
Hsiang-nan Li
Abstract:
We propose that the different angular distributions in two-photon collisions observed at low and high center-of-mass energies $W_{γγ}$ indicate the transition from nonperturbative to perturbative QCD. We calculate the differential cross sections of $γγ\toππ$, $KK$ in the angle $θ$ of one of the final-state mesons using QCD sum rules and the perturbative QCD approach based on $k_T$ factorization…
▽ More
We propose that the different angular distributions in two-photon collisions observed at low and high center-of-mass energies $W_{γγ}$ indicate the transition from nonperturbative to perturbative QCD. We calculate the differential cross sections of $γγ\toππ$, $KK$ in the angle $θ$ of one of the final-state mesons using QCD sum rules and the perturbative QCD approach based on $k_T$ factorization theorem. Our predictions from sum rules (perturbative QCD) decrease (increase) with $|\cosθ|$, consistent with the Belle data of $γγ\to K^+K^-$ for $W_{γγ}\approx 1.5$-1.7 (2.2-2.4) GeV.
△ Less
Submitted 1 July, 2004; v1 submitted 13 April, 2004;
originally announced April 2004.
-
Are there significant scalar resonances in $B^{-}\to D^{(*)0} K^{-} {K}^{0}$ decays?
Authors:
Ron-Chou Hsieh,
Chuan-Hung Chen
Abstract:
We study the indication of large different branching ratios between $B^{-}\to D^{(*)0} K^{-} {K}^{0}$ and $\bar{B}_{d}\to D^{(*)+} K^{-} {K}^{0}$ observed by Belle. Interestingly, the same situation is not found in the decays $B\to D^{(*)} K^{-} {K}^{*0}$. If there exist no intermediate resonances in the decays $B^{-}\to D^{(*)0} K^{-} {K}^{0}$, a puzzle will be arisen. We find that the color-su…
▽ More
We study the indication of large different branching ratios between $B^{-}\to D^{(*)0} K^{-} {K}^{0}$ and $\bar{B}_{d}\to D^{(*)+} K^{-} {K}^{0}$ observed by Belle. Interestingly, the same situation is not found in the decays $B\to D^{(*)} K^{-} {K}^{*0}$. If there exist no intermediate resonances in the decays $B^{-}\to D^{(*)0} K^{-} {K}^{0}$, a puzzle will be arisen. We find that the color-suppressed processes $B^{-}\to D^{(*)0}a^{-}_{0}(1450)$ with $a^{-}_{0}(1450)\to K^{-} {K}^{0}$ could be one of the candidates to enhance the BRs of $B^{-}\to D^{(*)0} K^{-} {K}^{0}$. Our conjecture can be examined by the Dalitz plot technique and the analysis of angular dependence on $K^{-} {K}^{0}$ state at $B$ factories.
△ Less
Submitted 14 January, 2004;
originally announced January 2004.
-
The difficulty in the decay constants and spectra of $D^{*}_{sJ}$
Authors:
Ron-Chou Hsieh,
Chuan-Hung Chen,
Chao-Qiang Geng
Abstract:
We examine the compatibility in predicted masses and the decay constants of $D^{*}_{sJ}$ mesons in terms of two-quark contents. We find that the results of a specific model, which is governed by heavy quark limit, will encounter a challenge to fit both spectra and decay constants simultaneously.
We examine the compatibility in predicted masses and the decay constants of $D^{*}_{sJ}$ mesons in terms of two-quark contents. We find that the results of a specific model, which is governed by heavy quark limit, will encounter a challenge to fit both spectra and decay constants simultaneously.
△ Less
Submitted 17 December, 2003;
originally announced December 2003.
-
Effective Meson Field Theory from QCD
Authors:
Ron-Chou Hsieh
Abstract:
We give a simple and straightforward procedure of how to construct an effective meson Lagrangian from QCD Lagrangian. We integrate the methods of Gasser, Leutwyler, Alkofer and Reinhardt and use the derivative expansion scheme to derive the low energy effective Lagrangian for meson fields to $O(p^4)$. In this paper, why the meson particle can be treated as the goldstone mode is very clear. In ou…
▽ More
We give a simple and straightforward procedure of how to construct an effective meson Lagrangian from QCD Lagrangian. We integrate the methods of Gasser, Leutwyler, Alkofer and Reinhardt and use the derivative expansion scheme to derive the low energy effective Lagrangian for meson fields to $O(p^4)$. In this paper, why the meson particle can be treated as the goldstone mode is very clear. In our calculation the result in $O(p^2)$ is the same as in the chiral perturbation theory, but the result in $O(p^4)$ is different from that in literature. We will discuss the discrepancies and give some remarks on our result.
△ Less
Submitted 14 August, 2003; v1 submitted 16 June, 2003;
originally announced June 2003.
-
Split Dimensional Regularization for the Temporal Gauge
Authors:
Yaw-Hwang Chen,
Ron-Jou Hsieh,
Chilong Lin
Abstract:
A split dimensional regularization, which was introduced for the Coulomb gauge by Leibbrandt and Williams, is used to regularize the spurious singularities of Yang-Mills theory in the temporal gauge. Typical one-loop split dimensionally regularized temporal gauge integrals, and hence the renormalization structure of the theory are shown to be the same as those calculated with some nonprincipal-v…
▽ More
A split dimensional regularization, which was introduced for the Coulomb gauge by Leibbrandt and Williams, is used to regularize the spurious singularities of Yang-Mills theory in the temporal gauge. Typical one-loop split dimensionally regularized temporal gauge integrals, and hence the renormalization structure of the theory are shown to be the same as those calculated with some nonprincipal-value prescriptions.
△ Less
Submitted 22 October, 1996;
originally announced October 1996.
