NEURON MODEL SIGMOID ACTIVATION FUNCTION BASED ON MULTI-OPTIONAL FUNCTIONS ENTROPY CONDITIONAL OPTIMIZATION DOCTRINE
DOI:
https://doi.org/10.18372/1990-5548.58.13518Keywords:
Neuron initialization, activation function, sigmoid function, multi-optional doctrine, conditional optimality, hybrid-optional effectiveness function, pseudo-entropy, variational problemAbstract
It is made an attempt to discover an explainable plausible reason for a neuron activation function, of a sigmoid type function like logistic function, substantiation in terms of the multi-optional conditional optimality doctrine for the special hybrid-optional effectiveness functions uncertainty. In the studied case, the input-output mapping is stipulated by the entropy of the activation function conditional optimal distribution in regards with the induced local field of the neuron. It is proposed to evaluate the direction of uncertainty with the combined hybrid relative pseudo-entropy function. This is a new insight into the scientific substantiation of the well-known dependency derived in another way. The developed theoretical contemplations and mathematical derivations are verified with numerical simulation and plotted diagrams.
References
S. Haykin, Neural Networks. A Comprehensive Foundation, Moscow, Russia: “Williams,” 2006, 1104 p.
J. M. Fernandes dos Santos, Data Classification with Neural Networks and Entropic Criteria, Thesis submitted to the Engineering University of Porto, Portugal, for the partial fulfillment of the requirements for the degree of Doctor of Philosophy, Porto, Portugal: Engineering University, January 2007, 240 p.
E. T. Jaynes, “Information theory and statistical mechanics,” Physical review. vol. 106, no. 4, pp. 620–630, 1957.
E. T. Jaynes, “Information theory and statistical mechanics. II.” Physical review. 1957. vol. 108, no. 2, pp. 171–190.
E. T. Jaynes, “On the rationale of maximum-entropy methods,” Proceedings of the IEEE. 1982. vol. 70, pp. 939–952.
V. Kasianov, Subjective Entropy of Preferences, Subjective Analysis: Monograph, Warsaw, Poland: Institute of Aviation Scientific Publications, 2013, 644 p. (ISBN 978-83-63539-08-5)
F. C. Ma, P. H. Lv, and M. Ye, “Study on Global Science and Social Science Entropy Research Trend.” 2012 IEEE fifth international conference on advanced computational intelligence (ICACI), October 18–20, 2012, Nanjing, Jiangsu, China, 2012, pp. 238–242.
A. Goncharenko, “Aircraft Operation Depending upon the Uncertainty of Maintenance Alternatives.” Aviation. vol. 21, no. 4, pp. 126–131, 2017.
A. Goncharenko, “Development of a Theoretical Approach to the Conditional Optimization of Aircraft Maintenance Preference Uncertainty,” Aviation. vol. 22, no. 2, pp. 40–44, 2018.
C. B. Zamfirescu, L. Duta, and B. Iantovics, “On Investigating the Cognitive Complexity of Designing the Group Decision Process,” Studies in Informatics and Control. 2010. vol. 19, no. 3, pp. 263–270.
C. B. Zamfirescu, L. Duta, and B. Iantovics, “The Cognitive Complexity in Modelling the Group Decision Process,” BRAIN. Broad Research in Artificial Intelligence and Neuroscience. 2010. vol. 1, pp. 69–79.
R. D. Luce and D. H. Krantz, “Conditional Expected Utility,” Econometrica, no. 39, pp. 253–271, 1971.
R. D. Luce, Individual Choice Behavior: A Theoretical Analysis, Mineola, N. Y.: Dover Publications, 2014, 153 p.
A. V. Goncharenko, “Measures for Estimating Transport Vessels Operators’ Subjective Preferences Uncertainty,” Scientific Bulletin of Kherson State Maritime Academy. 2012. vol. 1(6), pp. 59–69.
A. V. Goncharenko, “Applicable Aspects of Alternative UAV Operation,” 2015 IEEE 3rd International Conference “Actual Problems of Unmanned Aerial Vehicles Developments (APUAVD)” Proceedings. October 13–15, 2015, Kyiv, Ukraine, 2015, pp. 316–319.
A. V. Goncharenko, “An Alternative Method of the Main Psychophysics Law Derivation,” Clin. and Exp. Psychol. 2017, vol. 3(155), pp. 1–5.
A. V. Goncharenko, “Several Models of Physical Exercise Subjective Preferences,” Clin. and Exp. Psychol, vol. 2(121), pp. 1–6, 2016.
A. V. Goncharenko, “Artificial Versus Natural Intellect in Control of Optimality,” Intellectual Decision-Making Systems and Problems of Computational Intelligence, May 20–24, 2013, Yevpatoria, Ukraine, 2013, pp. 20–22.
A. V. Goncharenko, “Mathematical Modeling of the Ship’s Main Engine Random Operational Process,” Internal Combustion Engines. 2012. no. 2, 117–125.
A. V. Goncharenko, “Alternativeness of Control and Power Equipment Repair versus Purchasing According to the Preferences of the Options,” Electronics and Control Systems. 2016. vol. 4(50), pp. 98–101. (ISSN: 1990-5548)
A. V. Goncharenko, “One Theoretical Aspect of Entropy Paradigm Application to the Problems of Tribology,” Problems of Friction and Wear. vol. 1(74), pp. 78–83, 2017.
A. V. Goncharenko, “Aeronautical Engineering Maintenance Periodicity Optimization with the Help of Subjective Preferences Distributions.” Proceedings of NAU. vol. 2(71), 2017, pp. 51–56.
A. V. Goncharenko, “A Concept of Multi-Optional Optimality at Modeling Ideal Gas Isothermal Processes,” Electronics and Control Systems. vol. 2(52). pp. 94–97, 2017.
O. A. Sushchenko, Y. M. Bezkorovainyi, and N. D. Novytska “Assessment of Accuracy of Nonorthogonal Redundant Inertial Measuring Instruments.” Electronics and Control Systems. 2017. vol. 3(53). pp. 17–25. (ISSN: 1990-5548)
V. M. Sineglazov and I. S. Shvaliuk, “Classification of Vertical-Axis Wind Power Plants with Rotary Blades,” Electronics and Control Systems, vol. 3(53). pp. 84–87, 2017. (ISSN: 1990-5548)
V. M. Sineglazov, A. A. Ziganshin, and M. P. Vasylenko, “Computer-Aided Design of Wind Power System with Combined Rotor,” Electronics and Control Systems, vol. 3(49), pp. 73–78, 2016, (ISSN: 1990-5548)
O. A. Sushchenko, “Features of Control of Tracking Modes,” Electronics and Control Systems, vol. 3(49), pp. 40–47, 2016. (ISSN: 1990-5548)
K. Szafran and I. Kramarski, “Safety of Navigation on the Approaches to the Ports of the Republic of Poland on the Basis of the Radar System on the Aerostat Platform,” The International Journal on Marine Navigation and Safety of Sea Transportation, vol. 9, no. 1. pp. 131–136, 2015. (ISSN: 2083-6473)
O. Zaporozhets, V. Tokarev, and K. Attenborough, Aircraft Noise. Assessment, Prediction and Control, Glyph International, Tailor and Francis, 2011, 480 p.
S. Dmitriyev, A. Koudrin, A. Labunets, and M. Kindrachuk, “Functional Coatings Application for Strengthening and Restoration of Aviation Products,” Aviation, vol. 9, no. 4. pp. 39–45, 2005.
O. Solomentsev, M. Zaliskyi, and O. Zuiev, “Estimation of Quality Parameters in the Radio Flight Support Operational System,” Aviation, vol. 20, no. 3, pp. 123–128, 2016.
T. Shmelova, Y. Sikirda, N. Rizun, A.-B. M. Salem, and Y. N. Kovalyov, Socio-Technical Decision Support in Air Navigation Systems: Emerging Research and Opportunities, Pennsylvania, USA: International Publisher of Progressive Information Science and Technology Research, 2017, 264 p.
M. Kulyk and G. Suslova, “Integration of the ICAO Training Institute into the International Education Network,” Aviation. vol. 18, no. 2, pp. 104–108, 2014.
V. Chepizenko, V. Kharchenko, and S. Pavlova, “Synergy of Piloted, Remotely Piloted and Unmanned Air Systems in Single Air Navigation Space,” Logistics and transport, vol. 2(18), pp. 77–82, 2013.
V. M. Sineglazov and V. O. Glukhov, “Intelligent System of Helicopter Pilots Simulator Training,” Electronics and Control Systems, vol. 4(54), pp. 89–94, 2017. (ISSN: 1990-5548)
V. Kasjanov and K. Szafran, “Some Hybrid Models of Subjective Analysis in the Theory of Active Systems,” Transactions of the Institute of Aviation. vol. 3(240), pp. 27–31, 2015. (ISSN: 0509-6669)
Downloads
Issue
Section
License
Authors who publish with this journal agree to the following terms:
Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
