Sensor fusion is the process of combining sensor data or data derived from disparate sources so that the resulting information has less uncertainty than would be possible if these sources were used individually. For instance, one could potentially obtain a more accurate location estimate of an indoor object by combining multiple data sources such as video cameras and WiFi localization signals. The term uncertainty reduction in this case can mean more accurate, more complete, or more dependable, or refer to the result of an emerging view, such as stereoscopic vision (calculation of depth information by combining two-dimensional images from two cameras at slightly different viewpoints).[1][2]
The data sources for a fusion process are not specified to originate from identical sensors. One can distinguish direct fusion, indirect fusion and fusion of the outputs of the former two. Direct fusion is the fusion of sensor data from a set of heterogeneous or homogeneous sensors, soft sensors, and history values of sensor data, while indirect fusion uses information sources like a priori knowledge about the environment and human input.
Two example sensor fusion calculations are illustrated below.
Let and denote two sensor measurements with noise variances and
, respectively. One way of obtaining a combined measurement is to apply inverse-variance weighting, which is also employed within the Fraser-Potter fixed-interval smoother, namely
[6]
,
where is the variance of the combined estimate. It can be seen that the fused result is simply a linear combination of the two measurements weighted by their respective noise variances.
Another (equivalent) method to fuse two measurements is to use the optimal Kalman filter. Suppose that the data is generated by a first-order system and let denote the solution of the filter's Riccati equation. By applying Cramer's rule within the gain calculation it can be found that the filter gain is given by:[citation needed]
By inspection, when the first measurement is noise free, the filter ignores the second measurement and vice versa. That is, the combined estimate is weighted by the quality of the measurements.
Centralized versus decentralized
In sensor fusion, centralized versus decentralized refers to where the fusion of the data occurs. In centralized fusion, the clients simply forward all of the data to a central location, and some entity at the central location is responsible for correlating and fusing the data. In decentralized, the clients take full responsibility for fusing the data. "In this case, every sensor or platform can be viewed as an intelligent asset having some degree of autonomy in decision-making."[7]
Multiple combinations of centralized and decentralized systems exist.
Another classification of sensor configuration refers to the coordination of information flow between sensors.[8][9] These mechanisms provide a way to resolve conflicts or disagreements and to allow the development of dynamic sensing strategies.
Sensors are in redundant (or competitive) configuration if each node delivers independent measures of the same properties. This configuration can be used in error correction when comparing information from multiple nodes. Redundant strategies are often used with high level fusions in voting procedures.[10][11]
Complementary configuration occurs when multiple information sources supply different information about the same features. This strategy is used for fusing information at raw data level within decision-making algorithms. Complementary features are typically applied in motion recognition tasks with Neural network,[12][13]Hidden Markov model,[14][15]Support-vector machine,[16] clustering methods and other techniques.[16][15]
Cooperative sensor fusion uses the information extracted by multiple independent sensors to provide information that would not be available from single sensors. For example, sensors connected to body segments are used for the detection of the angle between them. Cooperative sensor strategy gives information impossible to obtain from single nodes. Cooperative information fusion can be used in motion recognition,[17]gait analysis, motion analysis,[18][19],.[20]
Levels
There are several categories or levels of sensor fusion that are commonly used.
[21][22][23][24][25][26]
Tracking and object detection/recognition/identification
Level 2 – Situation assessment
Level 3 – Impact assessment
Level 4 – Process refinement (i.e. sensor management)
Level 5 – User refinement
Sensor fusion level can also be defined basing on the kind of information used to feed the fusion algorithm.[27] More precisely, sensor fusion can be performed fusing raw data coming from different sources, extrapolated features or even decision made by single nodes.
Data level - data level (or early) fusion aims to fuse raw data from multiple sources and represent the fusion technique at the lowest level of abstraction. It is the most common sensor fusion technique in many fields of application. Data level fusion algorithms usually aim to combine multiple homogeneous sources of sensory data to achieve more accurate and synthetic readings.[28] When portable devices are employed data compression represent an important factor, since collecting raw information from multiple sources generates huge information spaces that could define an issue in terms of memory or communication bandwidth for portable systems. Data level information fusion tends to generate big input spaces, that slow down the decision-making procedure. Also, data level fusion often cannot handle incomplete measurements. If one sensor modality becomes useless due to malfunctions, breakdown or other reasons the whole systems could occur in ambiguous outcomes.
Feature level - features represent information computed on board by each sensing node. These features are then sent to a fusion node to feed the fusion algorithm.[29] This procedure generates smaller information spaces with respect to the data level fusion, and this is better in terms of computational load. Obviously, it is important to properly select features on which to define classification procedures: choosing the most efficient features set should be a main aspect in method design. Using features selection algorithms that properly detect correlated features and features subsets improves the recognition accuracy but large training sets are usually required to find the most significant feature subset.[27]
Decision level - decision level (or late) fusion is the procedure of selecting an hypothesis from a set of hypotheses generated by individual (usually weaker) decisions of multiple nodes.[30] It is the highest level of abstraction and uses the information that has been already elaborated through preliminary data- or feature level processing. The main goal in decision fusion is to use meta-level classifier while data from nodes are preprocessed by extracting features from them.[31] Typically decision level sensor fusion is used in classification an recognition activities and the two most common approaches are majority voting and Naive-Bayes.[citation needed] Advantages coming from decision level fusion include communication bandwidth and improved decision accuracy. It also allows the combination of heterogeneous sensors.[29]
Applications
One application of sensor fusion is GPS/INS, where Global Positioning System and inertial navigation system data is fused using various different methods, e.g. the extended Kalman filter. This is useful, for example, in determining the attitude of an aircraft using low-cost sensors.[32] Another example is using the data fusion approach to determine the traffic state (low traffic, traffic jam, medium flow) using road side collected acoustic, image and sensor data.[33] In the field of autonomous driving, sensor fusion is used to combine the redundant information from complementary sensors in order to obtain a more accurate and reliable representation of the environment.[34]
Although technically not a dedicated sensor fusion method, modern Convolutional neural network based methods can simultaneously process many channels of sensor data (such as Hyperspectral imaging with hundreds of bands [35]) and fuse relevant information to produce classification results.
^Galar, Diego; Kumar, Uday (2017). eMaintenance: Essential Electronic Tools for Efficiency. Academic Press. p. 26. ISBN9780128111543.
^Li, Wenfeng; Bao, Junrong; Fu, Xiuwen; Fortino, Giancarlo; Galzarano, Stefano (2012). "Human Postures Recognition Based on D-S Evidence Theory and Multi-sensor Data Fusion". 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012). pp. 912–917. doi:10.1109/CCGrid.2012.144. ISBN978-1-4673-1395-7. S2CID1571720.
^Chia Bejarano, Noelia; Ambrosini, Emilia; Pedrocchi, Alessandra; Ferrigno, Giancarlo; Monticone, Marco; Ferrante, Simona (2015). "A Novel Adaptive, Real-Time Algorithm to Detect Gait Events From Wearable Sensors". IEEE Transactions on Neural Systems and Rehabilitation Engineering. 23 (3): 413–422. doi:10.1109/TNSRE.2014.2337914. hdl:11311/865739. ISSN1534-4320. PMID25069118. S2CID25828466.
^Wang, Zhelong; Qiu, Sen; Cao, Zhongkai; Jiang, Ming (2013). "Quantitative assessment of dual gait analysis based on inertial sensors with body sensor network". Sensor Review. 33 (1): 48–56. doi:10.1108/02602281311294342. ISSN0260-2288.
^Blasch, E., Plano, S. (2003) “Level 5: User Refinement to aid the Fusion Process”, Proceedings of the SPIE, Vol. 5099.
^J. Llinas; C. Bowman; G. Rogova; A. Steinberg; E. Waltz; F. White (2004). Revisiting the JDL data fusion model II. International Conference on Information Fusion. CiteSeerX10.1.1.58.2996.
^Blasch, E., Steinberg, A., Das, S., Llinas, J., Chong, C.-Y., Kessler, O., Waltz, E., White, F. (2013) "Revisiting the JDL model for information Exploitation," International Conference on Information Fusion.
^ abGravina, Raffaele; Alinia, Parastoo; Ghasemzadeh, Hassan; Fortino, Giancarlo (2017). "Multi-sensor fusion in body sensor networks: State-of-the-art and research challenges". Information Fusion. 35: 68–80. doi:10.1016/j.inffus.2016.09.005. ISSN1566-2535. S2CID40608207.
^Gao, Teng; Song, Jin-Yan; Zou, Ji-Yan; Ding, Jin-Hua; Wang, De-Quan; Jin, Ren-Cheng (2015). "An overview of performance trade-off mechanisms in routing protocol for green wireless sensor networks". Wireless Networks. 22 (1): 135–157. doi:10.1007/s11276-015-0960-x. ISSN1022-0038. S2CID34505498.
^ abChen, Chen; Jafari, Roozbeh; Kehtarnavaz, Nasser (2015). "A survey of depth and inertial sensor fusion for human action recognition". Multimedia Tools and Applications. 76 (3): 4405–4425. doi:10.1007/s11042-015-3177-1. ISSN1380-7501. S2CID18112361.
^Banovic, Nikola; Buzali, Tofi; Chevalier, Fanny; Mankoff, Jennifer; Dey, Anind K. (2016). "Modeling and Understanding Human Routine Behavior". Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16. pp. 248–260. doi:10.1145/2858036.2858557. ISBN9781450333627. S2CID872756.
^Maria, Aileni Raluca; Sever, Pasca; Carlos, Valderrama (2015). "Biomedical sensors data fusion algorithm for enhancing the efficiency of fault-tolerant systems in case of wearable electronics device". 2015 Conference Grid, Cloud & High Performance Computing in Science (ROLCG). pp. 1–4. doi:10.1109/ROLCG.2015.7367228. ISBN978-6-0673-7040-9. S2CID18782930.
^Gross, Jason; Yu Gu; Matthew Rhudy; Srikanth Gururajan; Marcello Napolitano (July 2012). "Flight Test Evaluation of Sensor Fusion Algorithms for Attitude Estimation". IEEE Transactions on Aerospace and Electronic Systems. 48 (3): 2128–2139. Bibcode:2012ITAES..48.2128G. doi:10.1109/TAES.2012.6237583. S2CID393165.
^Joshi, V., Rajamani, N., Takayuki, K., Prathapaneni, N., Subramaniam, L. V. (2013). Information Fusion Based Learning for Frugal Traffic State Sensing. Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence.{{cite conference}}: CS1 maint: multiple names: authors list (link)
Люсі-сюр-ІоннLucy-sur-Yonne Країна Франція Регіон Бургундія-Франш-Конте Департамент Йонна Округ Осер Код INSEE 89234 Поштові індекси 89480 Координати 47°38′00″ пн. ш. 3°45′00″ сх. д.H G O Висота 132 - 210 м.н.р.м. Площа 8,19 км² Населення 119 (01-2020[1]) Густота 18,56 ос./км² Розміщен...
Spencer Fox Información personalNacimiento 10 de mayo de 1993 (30 años)Nueva York (Estados Unidos) Nacionalidad EstadounidenseLengua materna Inglés Información profesionalOcupación Actor, actor de televisión, actor de voz, disc-jockey, productor discográfico, cantante, cantautor y compositor de canciones Años activo 2004-presente[editar datos en Wikidata] Spencer Fox (10 de mayo de 1993) es un actor estadounidense. Es conocido por haber puesto voz a Dashiell Robert Parr, el ni
Marawis Marawis (bahasa Arab: مراويس) adalah salah satu jenis band tepuk dengan perkusi sebagai alat musik utamanya. Musik ini merupakan kolaborasi antara kesenian Timur Tengah dan Betawi, dan memiliki unsur keagamaan yang kental. Itu tercermin dari berbagai lirik lagu yang dibawakan yang merupakan pujian dan kecintaan kepada Sang Pencipta. Sejarah Kesenian marawis berasal dari negara timur tengah terutama dari Yaman. Nama marawis diambil dari nama salah satu alat musik yang dipergunaka...
Canadian sci-fi, fantasy, comedy short film by Jonathan Williams The PortalPenikett on the set of The PortalDirected byJonathan WilliamsWritten byJonathan WilliamsProduced byAndrew Nicholas McCann Smith, Laura PerlmutterStarringTahmoh PenikettErin KarplukProductioncompanyFirst Love FilmsRelease date March 22, 2014 (2014-03-22) (Cleveland International Film Festival) Running time11 minutesLanguageEnglish The Portal is a Canadian sci-fi, fantasy, comedy short film directed an...
ANZ FijiANZ bank at Sigatoka, FijiFormerlyBankohTypeBank, Subsidiary of ANZ GroupIndustryFinancial servicesPredecessorANZ ASBFoundedDecember 16, 1880 (1880-12-16)HeadquartersFijiArea servedFijiKey peopleSaud Minam CEO of ANZ FijiProductsBusiness Banking and Retail Banking, Markets/International Trade Services, Risk, Credit, Operations and Human ResourcesBrandsANZServicesBankingParentANZ Group ANZ Fiji is the largest bank in Fiji and has about a 40% market share. ANZ Fiji curren...
Book by Atul Gawande For the film adaptation, see Being Mortal (film). Being Mortal: Medicine and What Matters in the End AuthorAtul GawandeCountryUnited States of AmericaLanguageEnglishPublishedOctober 7, 2014PublisherMetropolitan BooksISBN0805095152 Being Mortal: Medicine and What Matters in the End is a 2014 non-fiction book by American surgeon Atul Gawande. The book addresses end-of-life care, hospice care, and also contains Gawande's reflections and personal stories. He suggests that med...
Railway station in Adelaide, South Australia This article is about the suburban railway station in Adelaide, Australia. For the interstate terminal in Adelaide, see Adelaide Parklands Terminal. For the railway station in Belfast, see Adelaide railway station (Northern Ireland). AdelaideAdelaide railway station at night from North Terrace in 2015General informationLocationNorth Terrace, Adelaide[note 1]Coordinates34°55′16″S 138°35′47″E / 34.9211°S 138.5964°E...
Lottery of the U.S. state of New York This article needs additional citations for verification. Please help improve this article by adding citations to reliable sources. Unsourced material may be challenged and removed.Find sources: New York Lottery – news · newspapers · books · scholar · JSTOR (November 2020) (Learn how and when to remove this template message) New York LotteryFormation1967TypeLottery SystemHeadquartersSchenectady, New York, United St...
German researcher An editor has performed a search and found that sufficient sources exist to establish the subject's notability. These sources can be used to expand the article and may be described in edit summaries or found on the talk page. The article may include original research, or omit significant information about the subject. Please help improve this article by adding citations to reliable sources. Unsourced material may be challenged and removed.Find sources: Uwe Benkel ...
This article includes a list of general references, but it lacks sufficient corresponding inline citations. Please help to improve this article by introducing more precise citations. (March 2022) (Learn how and when to remove this template message) The native form of this personal name is Moór Emánuel. This article uses Western name order when mentioning individuals. Emánuel Moór. Emánuel Moór Pianoforte from around 1927 by Pleyel et Cie Emánuel Moór (Hungarian pronunciation: [...
Penembakan penghormatan dengan meriam (21-gun salute) yang dilakukan oleh Angkatan Laut Amerika Serikat pada saat wafatnya presiden ke-38 Amerika Serikat Gerald R. Ford Penembakan Kehormatan dengan Meriam (bahasa Inggris: 21-gun salute), di TNI disingkat Bakhor adalah suatu tata cara pemberian penghormatan oleh kesatuan artileri dari angkatan bersenjata suatu negara dengan cara menembakkan tembakan (biasanya peluru hampa) ke udara dengan meriam. Tradisi ini berawal dari praktik maritim pada a...
Type of moustache Not to be confused with Fu Manchu moustache or Handlebar moustache. Horseshoe moustache style A horseshoe moustache, also known as a biker moustache, is a full moustache with vertical extensions grown on the corners of the lips and down the sides of the mouth to the jawline, resembling an upside-down U or a horseshoe. The whiskers grown along the sides of the mouth in the horseshoe are sometimes referred to as pipes. The horseshoe is not to be confused with the Fu Manchu, wh...
Soto padangSemangkuk soto padangJenisSotoSajianMenu utamaTempat asalIndonesiaDaerahSumatera BaratDibuat olehMinangkabauSuhu penyajianPanasBahan utamaAneka soto ayam, sapi, atau jeroan tradisional Indonesia Media: Soto padang Soto padang sebelum diberi kuah Soto padang adalah hidangan berkuah kaldu sapi dengan bahan irisan daging sapi yang sudah digoreng kering, bihun, ditambah perkedel kentang dan dihidangkan panas-panas. Hidangan ini berasal dari kota Padang, Sumatera Barat.[1&...
AwardAfghanistan Campaign MedalObverse and reverseTypeCampaign medalAwarded forService in Afghanistan from October 24, 2001 to August 31, 2021.Presented bythe U.S. Department of Defense[1] and Department of Homeland Security[2]EligibilityU.S. military personnelStatusInactiveEstablishedEO 13363, November 29, 2004; 19 years ago (2004-11-29)First awardedJune 2005 (retroactive to October 24, 2001)Service ribbon and campaign streamer PrecedenceNext (higher)Ko...
Genus of ray-finned fishes Gnathonemus Gnathonemus petersii Scientific classification Domain: Eukaryota Kingdom: Animalia Phylum: Chordata Class: Actinopterygii Order: Osteoglossiformes Family: Mormyridae Subfamily: Mormyrinae Genus: GnathonemusT. N. Gill, 1863 Species see text Gnathonemus is a genus of elephantfish in the family Mormyridae. Species There are currently four recognized species in this genus:[1][2] Gnathonemus barbatus Poll 1967 (Angolan mormyrid) Gnathonemus ec...
1975 novel by Brian Garfield For other novels, see Hopscotch (disambiguation) § Fiction. For the 1980 film adaptation of the novel, see Hopscotch (film). First edition (publ. M. Evans) Hopscotch is a 1975 novel by Brian Garfield, in which a CIA field officer walks away from the Agency in order to keep from being retired and placed behind a desk, and invites the Agency to pursue him by writing an exposé and mailing chapters of it piecemeal to all the major intelligence agencies around t...
Pour les articles homonymes, voir Espagne (homonymie) et España. Royaume d’Espagne[1]Reino de España[2] Écouter Drapeau de l'Espagne Armoiries de l'Espagne Devise en latin : Plus ultra (« Plus loin ») Hymne en espagnol : Marcha Real (« Marche royale ») Fête nationale 12 octobre · Événement commémoré Découverte de l'Amérique par Christophe Colomb (1492) Le royaume d'Espagne en Europe (l'Union européenne en vert clair) Adm...
1956 film by John Sherwood The Creature Walks Among UsTheatrical release posterDirected byJohn SherwoodWritten byArthur A. RossBased onThe Creature of Man (treatment)by Arthur A. RossProduced byWilliam AllandStarringJeff MorrowRex ReasonLeigh SnowdenGregg PalmerMaurice MansonRicou BrowningDon MegowanCinematographyMaury GertsmanEdited byEdward CurtissMusic byIrving GertzHeinz RoemheldHenry ManciniProductioncompanyUniversal PicturesDistributed byUniversal PicturesRelease date April 26,...
Questa voce sull'argomento calciatori maliani è solo un abbozzo. Contribuisci a migliorarla secondo le convenzioni di Wikipedia. Segui i suggerimenti del progetto di riferimento. Jimmy Kébé Kébé nel 2011 al Reading Nazionalità Mali Altezza 187 cm Calcio Ruolo Centrocampista Termine carriera 23 gennaio 2015 Carriera Squadre di club1 2002-2006 Lens 257 (5)2006-2008 Lens0 (0)2006-2007 Châteauroux18 (2)2007-2008 Boulogne16 (5)2008-2013 Reading173 (29)201...