Advanced Matrix Extensions

Advanced Matrix Extensions (AMX), also known as Intel Advanced Matrix Extensions (Intel AMX), are extensions to the x86 instruction set architecture (ISA) for microprocessors from Intel originally designed to work on matrices to accelerate artificial intelligence (AI) and machine learning (ML) workloads.[1] They can also be applied to optimal routing problems, graph problems, optimisation and others.[2]

Extensions

AMX was introduced by Intel in June 2020 and first supported by Intel with the Sapphire Rapids microarchitecture for Xeon servers, released in January 2023.[3][4] It introduced 2-dimensional registers called tiles upon which accelerators can perform operations. It is intended as an extensible architecture; the first accelerator implemented is called tile matrix multiply unit (TMUL).[5][6]

In Intel Architecture Instruction Set Extensions and Future Features revision 46, published in September 2022, a new AMX-FP16 extension was documented. This extension adds support for half-precision floating-point numbers. In revision 48 from March 2023, AMX-COMPLEX was documented, adding support for half-precision floating-point complex numbers. Both extensions are available in the Granite Rapids set of server processors (with AMX-COMPLEX support only being available in Granite Rapids-D[7]).

Tile matrix multiply unit

TMUL unit supports BF16 and INT8 input types.[8] AMX-FP16 and AMX-COMPLEX also add support for real and complex FP16 numbers. The register file consists of 8 tiles, each with 16 rows of size of 64 bytes (32 BF16/FP16 or 64 INT8 elements). The only supported operation is matrix multiplication [5]

4th Gen Intel Xeon Scalable processor can perform 2048 INT8 or 1024 BF16 operations per cycle:[9][10] the maximal input sizes are for A and for B, where J is 64 for INT8 and 32 for BF16. The matrix multiplication requires multiplication and additions, thus performing operations in 16 cycles.[10]

Software support

References

  1. ^ Hemsoth, Nicole (August 19, 2021). "With AMX, Intel Adds AI/ML Sparkle to Sapphire Rapids". The Next Platform.
  2. ^ Respondek, J.S. (2025). Fast Matrix Multiplication with Applications, Ch. 9. Studies in Big Data. Vol. 166. Springer Cham. ISBN 978-3-031-76929-0.
  3. ^ online, heise (28 June 2020). "Intel AMX: Erste Informationen zur Advanced Matrix Extensions Architecture". heise online.
  4. ^ Cutress, Ian. "Intel Xeon Sapphire Rapids: How To Go Monolithic with Tiles". AnandTech.
  5. ^ a b "Intel® Architecture Instruction Set Extensions and Future Features".
  6. ^ Schor, David (June 29, 2020). "The x86 Advanced Matrix Extension (AMX) Brings Matrix Operations; To Debut with Sapphire Rapids".
  7. ^ Larabel, Michael (July 12, 2023). "Intel Granite Rapids D Support Merged Into GCC 14". Phoronix.
  8. ^ "Advanced Matrix Extension (AMX) - x86 - WikiChip". en.wikichip.org.
  9. ^ "Accelerate Artificial Intelligence (AI) Workloads with Intel Advanced Matrix Extensions (Intel AMX)" (PDF). Intel. Retrieved 2023-04-13.
  10. ^ a b "Intel® 64 and IA-32 Architectures Optimization Reference Manual Volume 1". Intel.
  11. ^ "What's New in LLVM for 4th Gen Intel® Xeon® & Max Series CPUs". Retrieved 21 April 2023.
  12. ^ Larabel, Michael (2020-07-02). "Intel AMX Support Begins Landing In LLVM". Phoronix. Retrieved 2020-07-02.
  13. ^ "[X86-64] Support Intel AMX instructions". GitHub. 2020-07-02. Retrieved 2020-07-02.
  14. ^ a b Larabel, Michael (2020-07-02). "Intel AMX Support Lands In The GNU Assembler". Phoronix. Retrieved 2020-07-02.
  15. ^ "GCC 11 Release Series — Changes, New Features, and Fixes - GNU Project". Retrieved 21 April 2023.
  16. ^ "[PATCH] Enable GCC support for AMX". 2020-07-06. Retrieved 2020-07-09.
  17. ^ "Enable GCC support for AMX-TILE, AMX-INT8, AMX-BF16. · gcc-mirror/gcc@5c60984". GitHub. Retrieved 2022-09-05.
  18. ^ "commits with Intel AMX". 2020-07-02. Retrieved 2020-07-02.
  19. ^ "x86: Detect Intel Advanced Matrix Extensions". 2020-07-02. Retrieved 2020-07-02.
  20. ^ "Linux 5.16 Features Include FUTEX2, Intel AMX, Folios, DG2/Alchemist, More Apple Silicon Support". Phoronix.
  21. ^ "Accessing Sapphire Rapids AMX instructions on vSphere". Earl C. Ruby III. 2023-08-24.

Read other articles:

Versalles Barrio de Buenos Aires País Argentina• Ciudad Buenos AiresUbicación 34°37′42″S 58°31′25″O / -34.628333333333, -58.523611111111Superficie 1,5 km²Límites NogoyáIrigoyenAv. Juan B. JustoAv. General PazPoblación  • Total 14 178 hab.• Densidad 9452 hab./km²Día del barrio 16 de noviembre[editar datos en Wikidata] Versalles (también conocido como Versailles) es uno de los barrios en ...

 

نظال مالك حسن (بالإنجليزية: Nidal Malik Hasan)‏، ونضال مالك حسن  معلومات شخصية الميلاد 8 سبتمبر 1970 (العمر 53 سنة)فيرجينيا -  الولايات المتحدة الجنسية  الولايات المتحدة أمريكي الديانة مسلم المذهب الفقهي أهل السنة والجماعة مشكلة صحية شلل سفلي  عدد الأولاد 2   الحياة العملية

 

У этого термина существуют и другие значения, см. Литовский полк. 51-й пехотный Литовский Его Императорского Высочества Наследника Цесаревича полк Годы существования 22 октября 1809 — 1918 Страна  Российская империя Входит в 13-я пех. див-я, 7 АК, ОдВО Тип пехота Дислокация Симф

Batalyon Artileri Medan 3/Naga PakcaLambang Yonarmed 3/Naga PakcaDibentuk11 Februari 1952NegaraIndonesiaCabangArmedTipe unitSatuan Bantuan TempurPeranPasukan Artilleri MedanBagian dariKodam IV/DiponegoroMarkasMagelang, Jawa TengahJulukanYonarmed 3/Naga PakcaMotoNaga PakçaBaretCoklatMaskotNaga HijauUlang tahun11 FebruariAlutsistaMeriam M2A2 105mm Batalyon Artileri Medan 3/Naga Pakca atau Yon Armed 3/105/Tarik adalah merupakan satuan bantuan tempur (satbanpur) organik dibawah Komando Kodam IV/...

 

Dieser Artikel behandelt die Gemeinde Rehden in Niedersachsen. Zu anderen Bedeutungen siehe Rehden (Begriffsklärung). Wappen Deutschlandkarte ? Hilfe zu Wappen 52.6091666666678.481111111111142Koordinaten: 52° 37′ N, 8° 29′ O Basisdaten Bundesland: Niedersachsen Landkreis: Diepholz Samtgemeinde: Rehden Höhe: 42 m ü. NHN Fläche: 33,35 km2 Einwohner: 2390 (31. Dez. 2022)[1] Bevölkerungsdichte: 72 Einwohner je km2 Postleitza...

 

1990 studio album by Dan FogelbergThe Wild PlacesStudio album by Dan FogelbergReleased1990GenreSoft rockLength52:04LabelFull Moon/EpicProducerDan FogelbergDan Fogelberg chronology Exiles(1987) The Wild Places(1990) Dan Fogelberg Live: Greetings from the West(1991) The Wild Places is an album by the American musician Dan Fogelberg, released in 1990.[1] Fogelberg's tour in support of the album included talks from The Wilderness Society about the preservation of nature.[2]...

سان مارتينو سيكوماريو     الإحداثيات 45°09′00″N 9°08′00″E / 45.15°N 9.1333333333333°E / 45.15; 9.1333333333333  [1] تقسيم إداري  البلد إيطاليا[2]  التقسيم الأعلى مقاطعة بابية  خصائص جغرافية  المساحة 14.29 كيلومتر مربع (9 أكتوبر 2011)[3]  ارتفاع 63 متر  عدد السكان...

 

حشيةمعلوماتالنوع لباس داخليتعديل - تعديل مصدري - تعديل ويكي بيانات الحَشِيَّة[1] أو القميص التحتيّ[2] (بالإنجليزية: slip)‏ (نقحرة: سليب) نوعٌ من الملابس الداخلية النسائية، لديه شكل فستان صغير، قد يصنع من الحرير أو الخيطل، وتلبسه النساء إما تحت الجبيبة أو الفستان. وقد ظه...

 

International sporting eventArchery – Men's individual at the 2015 Pan American GamesVenueVarsity StadiumDatesJuly 14–18Competitors32 from 14 nationsMedalists Luis Álvarez  Mexico Brady Ellison  United States Jason Lyon  Canada«2011 2019» Archery at the2015 Pan American GamesQualification IndividualmenwomenTeammenwomenvte The men's individual competition of the archery events at the 2015 Pan American Games will be held between...

بيير ترودو (بالفرنسية: Pierre Elliott Trudeau)‏  رئيس وزراء كندا في المنصب20 أبريل 1968 – 4 يونيو 1979 ليستر بولز بيرسون جو كلارك في المنصب3 مارس 1980 – 30 يونيو 1984 جو كلارك جون تيرنر معلومات شخصية اسم الولادة (بالفرنسية: Joseph Philippe Pierre Yves Elliott Trudeau)‏  الميلاد 18 أكتوبر 1919(1919-10-18)مونتريال الوفا...

 

Subclass of insects For other uses, see Pterygota (disambiguation). This article needs additional citations for verification. Please help improve this article by adding citations to reliable sources. Unsourced material may be challenged and removed.Find sources: Pterygota – news · newspapers · books · scholar · JSTOR (January 2015) (Learn how and when to remove this template message) PterygotaTemporal range: Serpukhovian–Recent PreꞒ Ꞓ O S D C P T...

 

Red Bull Red Bull GmbH Tipo Empresa privadaIndustria industria de bebidasindustria mediáticaForma legal Gesellschaft mit beschränkter HaftungFundación 1984 y 1 de abril de 1987Fundador Dietrich MateschitzChaleo YoovidhyaSede central Fuschl am See (Austria)Área de operación mundialProductos Red BullIngresos 7 931 000 000 € (2017)[1]​Beneficio económico 1 300 000 000 € (2018)Beneficio neto 650 000 000 € (2018)Propietario C...

Critical consumption is the conscious choice to buy or not buy a product because of ethical and political beliefs. The critical consumer considers characteristics of the product and its realization, such as environmental sustainability and respect of workers’ rights. Critical consumers take responsibility for the environmental, social, and political effects of their choices. The critical consumer sympathizes with certain social movement goals and contributes towards them by modifying their ...

 

2 Tawarikh 7Kitab Tawarikh (Kitab 1 & 2 Tawarikh) lengkap pada Kodeks Leningrad, dibuat tahun 1008.KitabKitab 2 TawarikhKategoriKetuvimBagian Alkitab KristenPerjanjian LamaUrutan dalamKitab Kristen14← pasal 6 pasal 8 → 2 Tawarikh 7 (atau II Tawarikh 7, disingkat 2Taw 7) adalah bagian dari Kitab 2 Tawarikh dalam Alkitab Ibrani dan Perjanjian Lama di Alkitab Kristen. Dalam Alkitab Ibrani termasuk dalam bagian Ketuvim (כְּתוּבִים, tulisan).[1][2] Teks Na...

 

1947 film by John English The Last Round-UpDirected byJohn EnglishScreenplay byJack TownleyStory byJack TownleyEarle SnellProduced byArmand SchaeferStarringGene AutryChampionCinematographyWilliam BradfordEdited byAaron StellColor processBlack and whiteProductioncompanyGene Autry ProductionsDistributed byColumbia PicturesRelease date November 5, 1947 (1947-11-05) Running time77 minutesCountryUnited StatesLanguageEnglish The Last Round-Up is a 1947 American Western film directed ...

Untuk kegunaan lain, lihat Aceh (disambiguasi). Koordinat: 4°14′N 97°58′E / 4.233°N 97.967°E / 4.233; 97.967 Kabupaten Aceh TamiangKabupatenTranskripsi bahasa daerah • Jawoe/Jawiاچيه تميانڠKuala Paret LambangMotto: Kaseh pape, setie mati(Tamiang) Seluruh aspek kehidupan, baik individu maupun masyarakat dilandasi dengan sikap rela berkorban dan saling tolong menolong dengan tanggung jawab dan kesetiaan tanpa pamrihPetaKabupaten Ac...

 

Untuk desa di Tibet, lihat Lingqu, Tibet. Lingqu Rute Lingqu (biru tua. Pembagian antara cekungan Yangzte (ke timur) dan Sungai Mutiara (ke barat) ditampilkan dengan garis hijau Lingqu (Hanzi sederhana: 灵渠; Hanzi tradisional: 靈渠; Pinyin: Líng Qú; harfiah: 'Bendungan Ajaib') adalah sebuah bendungan di Kabupaten Xing'an, dekat Guilin, di sebelah barat laut Guangxi, China. Bendungan tersebut menghubungan Sungai Xiang (yang mengalir ke utara menuju Yangtze) dengan Sungai...

 

This article has multiple issues. Please help improve it or discuss these issues on the talk page. (Learn how and when to remove these template messages) The neutrality of this article is disputed. Relevant discussion may be found on the talk page. Please do not remove this message until conditions to do so are met. (November 2019) (Learn how and when to remove this template message) This article contains content that is written like an advertisement. Please help improve it by removing promot...

This article is an orphan, as no other articles link to it. Please introduce links to this page from related articles; try the Find link tool for suggestions. (June 2018) Crafts village in Kerala, IndiaSargaalayaSaargalaya Boating FacilityLocation within KeralaGeneral informationTypeCrafts villageArchitectural styleEthnicLocationIringal, Vatakara , Kozhikode, Kerala, IndiaCoordinates11°33′36″N 75°36′21″E / 11.5601°N 75.6058°E / 11.5601; 75.6058Opened19 Feb ...

 

American-born Canadian lawyer and television producer Stephen StohnCMStohn in 2022BornMay 8, 1948 (1948-05-08) (age 75)Denver, Colorado, U.S.Occupation(s)Television producer, entertainment lawyerSpouse Linda Schuyler ​(m. 1995)​ChildrenMax Stohn John Stephen Stohn, CM (born May 8, 1948) is an American-born Canadian entertainment lawyer and television producer. He is best known for his involvement with the Degrassi teen drama franchise, particularly as an...

 

Strategi Solo vs Squad di Free Fire: Cara Menang Mudah!