The ever-increasing sizes of large language models necessitate distributed solutions for fast inference that exploit multi-dimensional parallelism, where computational loads are split across various accelerators such as GPU clusters. However, this approach often introduces significant communication overhead, especially on devices with limited bandwidth. In this paper, we introduce \emph{Flash Communication}, a novel low-bit compression technique designed to alleviate the tensor-parallelism communication bottleneck during inference. Our method substantially boosts intra-node communication speed by more than 3x and reduces the \emph{time-to-first-token} by 2x, with nearly no sacrifice in model accuracy. Extensive experiments on various up-to-date LLMs demonstrate the effectiveness of our approach.
The paper gives a brief introduction of the basic principles,the advantages and disadvantages,as well as the applied scope of the common stability analysis method of side-slope nowadays,gives the brief survey and expectation on the new stability analysis method of side-slope.According to all kinds of comprehensive analysis,the paper aims at have a more economic,safe and reliable stability in planning and evaluating the side-slope.
Discrimination of the production sites of ancient pottery by using lead isotopic composition is discussed in this paper. We have determined the lead isotopic compositions of ancient pottery from the Jiahu and Xishan sites, Henan Province. Most of Jiahu pottery show 206Pb/204Pb of 18.0 to 18.4 and 208Pb/204Pb of 38.4 to 38.8, while most of Xishan pottery show 206Pb/204Pb of 18.6 to 18.8 and 208Pb/204Pb of 38.7 to 39.1. Therefore, the lead isotopes are useful in discriminating the production sites of the ancient pottery in some cases.
This paper quantitatively characterises the microstructure in shales across five scales in 3D, builds a multi-scale model of CH4and CO2flow pathways and storage, and assesses the potential of enhanced gas recovery and CO2 storage simultaneously.
Variability in the Lower Bowland shale microstructure is investigated here, for the first time, from the centimetre to the micrometre scale using optical and scanning electron microscopy (OM, SEM), X-Ray Diffraction (XRD) and Total Organic Carbon content (TOC) measurements. A significant range of microtextures, organic-matter particles and fracture styles was observed in rocks of the Lower Bowland shale, together with the underlying Pendleside Limestone and Worston Shale formations encountered the Preese Hall-1 Borehole, Lancashire, UK. Four micro-texture types were identified: unlaminated quartz-rich mudstone; interlaminated quartz- and pyrite-rich mudstone; laminated quartz and pyrite-rich mudstone; and weakly-interlaminated calcite-rich mudstone. Organic matter particles are classified into four types depending on their size, shape and location: multi-micrometre particles with and without macropores: micrometre-size particles in cement and between clay minerals; multi-micrometre layers; and organic matter in large pores. Fractures are categorized into carbonate-sealed fractures; bitumen-bearing fractures; resin-filled fractures; and empty fractures. We propose that during thermal maturation, horizontal bitumen-fractures were formed by overpressuring, stress relaxation, compaction and erosional offloading, whereas vertical bitumen-bearing, resin-filled and empty fractures may have been influenced by weak vertical joints generated during the previous period of veining. For the majority of samples, the high TOC (>2 wt%), low clay content (<20 wt%), high proportion of quartz (>50 wt%) and the presence of a multi-scale fracture network support the increasing interest in the Bowland Shale as a potentially exploitable oil and gas source. The microtextural observations made in this study highlight preliminary evidence of fluid passage or circulation in the Bowland Shale sequence during burial.
Download This Paper Open PDF in Browser Add Paper to My Library Share: Permalink Using these links will ensure access to this page indefinitely Copy URL Copy DOI
Thick layers of dark lacustrine mudstone in the Nenjiang Forma- tion record the evolution of local depositional environments in the Songliao Basin. This evolution in lake water is accurately reflected in variations in trace element compositions in sedimentary rocks. In this study, element geo- chemistry and clay mineralogy in successive cores were investigated to have a closer insight into the paleolimnological environment and organic accumulation during the Nenjiang epoch. Analysis of the contents of Mn, Ca and Ti, as well as Rb/Sr and Sr/Cu revealed that paleoclimate cycled between warm and humid to semi-arid and hot. The study of Sr/Ba ratios, clay minerals and stable isotopes indicated that both high and low salinity existed in two stages, and that high salinity in Member 1 of the Nenjiang Formation is likely correlated with transgressive events. Analysis of the ratios of V/V + Ni, Ni/V and Th/U suggested that the paleolimnological environment was reducing. The investigation of paleotemperature demonstrated that the Nenjiang Formation was deposited in a warm water environment, analysis of carbon and oxygen isotopes revealed its deposition in open paleolake. High paleoproductivity and salinity as well as redox potentials represent the most favorable environment for oil shale enrichment.
Determination of mineral texture and diagenetic features in mudstones is crucial to reveal the history of their pore systems and provides key information to predict their future sealing ability, reactivity and storage capacity for sequestered CO2, hydrogen storage or nuclear waste disposal. To understand the spatial transport and storage of fluids, it is necessary to map the distribution of minerals and fractures in three dimensions (3D). This study proposes a novel, multi-scale three-dimensional (3D) imaging method, i.e., a combination of synchrotron- sourced micro- x-ray tomography and lab- sourced nano-tomography, to investigate the sedimentology and diagenetic features of the Bowland Shale, one of the most volumetrically important mudstone-dominated systems in the UK. Diagenetic minerals have been identified and characterised, including pyrite, calcite, kaolinite, illite, chlorite, dolomite, ankerite and authigenic quartz (micro-sized quartz and quartz overgrowths). Multi-scale 3D images provide detailed information about dolomite-ankerite zonation and carbonate dissolution pores. These features cannot be observed or quantified by conventional 2D methods, and they have not been reported in this subject area before. Using these results, potential reactions during carbon storage and other subsurface storage applications are predicted.
'%3e%3cpath fill='%23012169' d='M0 0v30h60V0z'/%3e%3cpath stroke='%23fff' stroke-width='6' d='m0 0 60 30m0-30L0 30'/%3e%3cpath stroke='%23C8102E' stroke-width='4' d='m0 0 60 30m0-30L0 30' clip-path='url(%23b)'/%3e%3cpath stroke='%23fff' stroke-width='10' d='M30 0v30M0 15h60'/%3e%3cpath stroke='%23C8102E' stroke-width='6' d='M30 0v30M0 15h60'/%3e%3c/g%3e%3c/svg%3e)
'/%3e%3cuse xlink:href='%23a' transform='rotate(23.036 .093 25.536)'/%3e%3cuse xlink:href='%23a' transform='rotate(45.87 1.273 16.18)'/%3e%3cuse xlink:href='%23a' transform='rotate(69.945 .996 12.078)'/%3e%3cuse xlink:href='%23a' transform='rotate(20.66 -19.689 31.932)'/%3e%3c/svg%3e)