研究業績

ニューラルネットワークに関する研究業績をモデル別にまとめました。

複素連想記憶 (Complex-Valued Associative Memory)

論文

• M. Kobayashi: “Two-Level Complex-Valued Hopfield Neural Networks”, IEEE Transactions on Neural Networks and Learning Systems, Vol.32, No.5, pp.2274-2278 (2021)
• M. Kobayashi: “Complex-Valued Hopfield Neural Networks with Real Weights in Synchronous Mode”, Neurocomputing, Vol.423, pp.535-540 (2021)
• M. Tuji, T. Isokawa, M. Kobayashi, N. Matsui, N. Kamiura: “A Projection Rule for Complex-Valued Associative Memory with Partial Connections”, IEEJ Transactions on Electrical and Electronic Engineering, Vol.15, No.9, pp.1327-1336 (2020)
• M. Kobayashi: “Bicomplex Projection Rule for Complex-Valued Hopfield Neural Networks”, Neural Computation, Vol.32, No.11, pp.2237-2248 (2020)
• M. Kobayashi: “Fixed Points of Symmetric Complex-Valued Hopfield Neural Networks”, Neurocomputing, Vol.275, pp.132-136 (2018)
• M. Kobayashi: “Chaotic Complex-Valued Bipartite Auto-Associative Memory with a Periodic Activation Function”, IEEJ Transactions on Electrical and Electronic Engineering, Vol.12, No.4, pp.584-588 (2017)
• M. Kobayashi: “Fast Recall for Complex-Valued Hopfield Neural Networks with Projection Rules”, Computational Intelligence and Neuroscience, Vol.2017, Article ID 4894278, 6 pages (2017)
• M. Kobayashi: “Symmetric Complex-Valued Hopfield Neural Networks”, IEEE Transactions on Neural Networks and Learning Systems, Vol.28, No.4, pp.1011-1015 (2017)
• M. Kobayashi: “Gradient Descent Learning Rule for Complex-Valued Associative Memories with Large Constant Terms”, IEEJ Transactions on Electrical and Electronic Engineering, Vol.11, No.3, pp.357-363 (2016)
• Y. Suzuki, M. Kobayashi: “Complex-Valued Bipartite Auto-Associative Memory”, IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, Vol.E97-A, No.8, pp.1680-1687 (2014)
• S. Furusawa, M. Kobayashi: “Chaotic Complex-Valued Bidirectional Associative Memory with a Real-Valued Context Part”, Nonlinear Theory and Its Applications, Vol.4, No.3, pp.299-312 (2013)
• M. Kitahara, M. Kobayashi: “Projection Rule for Complex-Valued Associative Memory with Large Constant Terms”, Nonlinear Theory and Its Applications, Vol.3, No.3, pp.426-435 (2012)
• M. Kobayashi, H. Yamada, M. Kitahara: “Noise Robust Gradient Descent Learning for Complex-Valued Associative Memory”, IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, Vol.E94-A, No.8, pp.1756-1759 (2011)
• M. Kobayashi: “Pseudo-Relaxation Learning Algorithm for Complex-Valued Associative Memory”, International Journal of Neural Systems, Vol.18, No.2, pp.147-156 (2008)
• 小林正樹，山崎晴明: “複素多方向連想メモリ”, 電気学会論文誌C, Vol.125, No.8, pp.1290-1295 (2005)
  (英訳)
  M. Kobayashi，H. Yamazaki: “Complex-Valued Multidirectional Associative Memory”, Electrical Engineering in Japan, Vol.159, No.1, pp.39-45 (2007)
• 小林正樹，山崎晴明: “複素ボルツマンマシンの情報幾何”, 電子情報通信学会論文誌A, Vol.J87-A, No.8, pp.1093-1101 (2004)

国際会議

• T. Minemoto, T. Isokawa, M. Kobayashi, H. Nishimura, N. Matsui: “Retrieval Performance of Hopfield Associative Memory with Complex-Valued and Real-Valued Neurons”, International Joint Conference on Neural Networks (IJCNN 2016), pp.4133-4138 (2016)
• Y. Suzuki, M. Kobayashi: “Complex-Valued Bidirectional Auto-Associative Memory”, International Joint Conference on Neural Networks (IJCNN 2013), pp.984-990 (2013)
• Y. Suzuki, M. Kitahara, M. Kobayashi: “Dynamic Complex-Valued Associative Memory with Strong Bias Terms”, International Conference on Neural Information Processing (ICONIP 2011), pp.509-518 (2011)
• M. Kitahara, M. Kobayashi: “Complex-Valued Associative Memory with Strong Thresholds”, 2011 International Symposium on Nonlinear Theory and its Applications (NOLTA 2011), pp.362-365 (2011)

Rotor 連想記憶 (Rotor Associative Memory)

論文

• M. Kobayashi: “Noise Robust Projection Rule for Rotor and Matrix-Valued Hopfield Neural Networks”, IEEE Transactions on Neural Networks and Learning Systems, Vol.33, No.2, pp.567-576 (2022)
• M. Kobayashi: “Quaternion Projection Rule for Rotor Hopfield Neural Networks”, IEEE Transactions on Neural Networks and Learning Systems, Vol.32, No.2, pp.900-908 (2021)
• M. Kobayashi: “Diagonal Rotor Hopfield Neural Networks”, Neurocomputing, Vol.415, pp.40-47(2020)
• M. Kobayashi: “Storage Capacity of Rotor Hopfield Neural Networks”, Neurocomputing, Vol.316, pp.30-33 (2018)
• M. Kobayashi: “Decomposition of Rotor Hopfield Neural Networks using Complex Numbers”, IEEE Transactions on Neural Networks and Learning Systems, Vol.29, No.4, pp.1366-1370 (2018)
• M. Kobayashi: “Stability of Rotor Hopfield Neural Networks with Synchronous Mode”, IEEE Transactions on Neural Networks and Learning Systems, Vol.29, No.3, pp.744-748 (2018)
• M. Kobayashi: “Pseudomemories of Two-Dimensional Multistate Hopfield Neural Networks”, IEEJ Transactions on Electrical and Electronic Engineering, Vol.12, No.2, pp.269-272 (2017)
• M. Kobayashi: “Information Geometry of Rotor Boltzmann Machines”, Nonlinear Theory and Its Applications, Vol.7, No.2, pp.266-282 (2016)
• M. Kobayashi: “Attractors Accompanied with a Training Pattern of Multi-Valued Hopfield Neural Networks”, IEEJ Transactions on Electrical and Electronic Engineering, Vol.10, No.2, pp.195-200 (2015)
• M. Kitahara, M. Kobayashi: “Projection Rule for Rotor Hopfield Neural Networks”, IEEE Transactions on Neural Networks and Learning Systems, Vol.25, No.7, pp.1298-1307 (2014)
• 北原倫理，小林正樹: “ロータ連想記憶の勾配降下学習”, 電気学会論文誌C, Vol.131, No.1, pp.116-121 (2011)
• 北原倫理，小林正樹，服部元信: “ロータ連想記憶による偽記憶の削減”, 電気学会論文誌C, Vol.131, No.1, pp.109-115 (2011)

国際会議

• Y. Suzuki, M. Kitahara, M. Kobayashi: “Rotor Associative Memory with a Periodic Activation Function”, 2012 IEEE World Congress on Computational Intelligence (WCCI 2012), pp.720-727 (2012)
• M. Kitahara, M. Kobayashi: “Fundamental Abilities of Rotor Associative Memory”, 9th IEEE/ACIS International Conference on Computer and Information Science (ICIS 2010), pp.497-502 (2010)
• M. Kitahara, M. Kobayashi, M. Hattori: “Chaotic Rotor Associative Memory”, 2009 International Symposium on Nonlinear Theory and its Applications (NOLTA 2009), pp.399-402 (2009)

双曲連想記憶 (Hyperbolic-Valued Associative Memory)

論文

• M. Kobayashi: “Hyperbolic-Valued Hopfield Neural Networks in Hybrid Mode”, Neurocomputing, Vol.440, pp.275-278 (2021)
• M. Kobayashi: “Information Geometry of Hyperbolic-Valued Boltzmann Machines”, Neurocomputing, Vol.431, pp.163-168 (2021)
• M. Tuji, T. Isokawa, M. Kobayashi, N. Matsui, N. Kamiura: “Gradient Descent Learning for Hyperbolic Hopfield Associative Memory”, Transactions of the Institute of Systems, Control and Information Engineers, Vol.34, No.1, pp.11-22 (2021)
• M. Kobayashi: “Hyperbolic-Valued Hopfield Neural Networks in Synchronous Mode”, Neural Computation, Vol.32, No.9, pp.1685-1696 (2020)
• M. Kobayashi: “Noise Robust Projection Rule for Hyperbolic Hopfield Neural Networks”, IEEE Transactions on Neural Networks and Learning Systems, Vol.31, No.1, pp.352-356 (2020)
• M. Kobayashi: “Storage Capacity of Hyperbolic Hopfield Neural Networks”, Neurocomputing, Vol.369, pp.185-190 (2019)
• M. Kobayashi: “Hyperbolic Hopfield Neural Networks with Directional Multistate Activation Function”, Neurocomputing, Vol.275, pp.2217-2226 (2018)
• M. Kobayashi: “Hyperbolic Hopfield Neural Networks with Four-State Neurons”, IEEJ Transactions on Electrical and Electronic Engineering, Vol.12, No.3, pp.428-433 (2017)
• M. Kobayashi: “Global Hyperbolic Hopfield Neural Networks”, IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, Vol.E99-A, No.12, pp.2511-2516 (2016)
• M. Kobayashi: “Hyperbolic Hopfield Neural Networks”, IEEE Transactions on Neural Networks and Learning Systems, Vol.24, No.2, pp.335-341 (2013)

四元数連想記憶 (Quaternion-Valued Associative Memory)

論文

• M. Kobayashi: “Storage Capacity of Quaternion-Valued Hopfield Neural Networks with Dual Connections”, Neural Computation, Vol.33, No.8, pp.2226-2240 (2021)
• M. Kobayashi: “Quaternion-Valued Twin-Multistate Hopfield Neural Networks with Dual Connections”, IEEE Transactions on Neural Networks and Learning Systems, Vol.32, No.2, pp.892-899 (2021)
• M. Kobayashi: “Storage Capacities of Twin-multistate Quaternion Hopfield Neural Networks”, Computational Intelligence and Neuroscience, Vol.2018, Article ID 1275290, 5 pages (2018)
• M. Kobayashi: “Quaternionic Hopfield Neural Networks with Twin-Multistate Activation Function”, Neurocomputing, Vol.267, pp.304-310 (2017)
• M. Kobayashi: “Gradient Descent Learning for Quaternionic Hopfield Neural Network”, Neurocomputing, Vol.260, pp.174-179 (2017)
• M. Kobayashi: “Three-Dimensional Quaternionic Hopfield Neural Networks”, IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, Vol.E100-A, No.7, pp.1575-1577 (2017)
• M. Kobayashi: “Fixed Points of Split Quaternionic Hopfield Neural Networks”, Signal Processing, Vol.136, pp.38-42 (2017)
• M. Kobayashi: “Symmetric Quaternionic Hopfield Neural Networks”, Neurocomputing, Vol.240, pp.110-114 (2017)
• M. Kobayashi: “Rotational Invariance of Quaternionic Hopfield Neural Networks”, IEEJ Transactions on Electrical and Electronic Engineering, Vol.11, No.4, pp.516-520 (2016)
• M. Kobayashi: “Hybrid Quaternionic Hopfield Neural Network”, IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, Vol.E98-A, No.7, pp.1512-1518 (2015)

国際会議

• T. Minemoto, T. Isokawa, M. Kobayashi, H. Nishimura, N. Matsui: “Pattern Retrieval by Quaternionic Associative Memory with Dual Connections”, International Conference on Neural Information Processing (ICONIP 2016), pp.317-325 (2016)
• T. Minemoto, T. Isokawa, M. Kobayashi, H. Nishimura, N. Matsui: “On the Performance of Quaternionic Bidirectional Auto-Associative Memory”, International Joint Conference on Neural Networks (IJCNN 2015), pp.2910-2915 (2015)

双複素数連想記憶 (BiComplex-Valued Associative Memory)

論文

• M. Kobayashi: “Bicomplex-Valued Twin-Hyperbolic Hopfield Neural Networks”, Neurocomputing, Vol.434, pp.203-210 (2021)
• M. Kobayashi: “Stability Conditions of Bicomplex-Valued Hopfield Neural Networks”, Neural Computation, Vol.33, No.2, pp.552-562(2021)
• M. Kobayashi: “Twin-Multistate Commutative Quaternion Hopfield Neural Networks”, Neurocomputing, Vol.320, pp.150-156 (2018)

その他の高次元連想記憶モデル

論文

• M. Kobayashi: “Noise Robust Projection Rule for Klein Hopfield Neural Networks”, Neural Computation, Vol.33, No.6, pp.1698-1716 (2021)
• M. Kobayashi: “Synthesis of Complex- and Hyperbolic-Valued Hopfield Neural Networks”, Neurocomputing, Vol.423, pp.80-88 (2021)
• M. Kobayashi: “Split Quaternion-Valued Twin-Multistate Hopfield Neural Networks”, Advances in Applied Clifford Algebras, Vol.30, No.3, Article number 30 (2020)
• M. Kobayashi: “Matrix-Valued Twin-Multistate Hopfield Neural Networks”, Neurocomputing, Vol.397, pp.108-113 (2020)
• M. Kobayashi: “Hopfield Neural Networks Using Klein Four-Group”, Neurocomputing, Vol.387, pp.123-128 (2020)
• M. Kobayashi: “O(2)-Valued Hopfield Neural Networks”, IEEE Transactions on Neural Networks and Learning Systems, Vol.30, No.12, pp.3833-3838 (2019)
• M. Kobayashi: “Dual-Numbered Hopfield Neural Networks”, IEEJ Transactions on Electrical and Electronic Engineering, Vol.13, No.2, pp.280-284 (2018)
• M. Kobayashi: “Multistate Vector Product Hopfield Neural Networks”, Neurocomputing, Vol.272, pp.425-431 (2018)
• 小林正樹: “外積を利用した３次元連想記憶”, 電気学会論文誌C, Vol.124, No.1, pp.150-156 (2004)

高次元 MLP (High-Dimensional MultiLayer Perceptron)

論文

• M. Kobayashi: “Reducibilities of Hyperbolic Neural Networks”, Neurocomputing, Vol.378, pp.129-141 (2020)
• M. Kobayashi: “Singularities of Three-Layered Complex-Valued Neural Networks with Split Activation Function”, IEEE Transactions on Neural Networks and Learning Systems, Vol.29, No.5, pp.1900-1907 (2018)
• M. Kobayashi: “Uniqueness Theorem for Quaternionic Neural Networks”, Signal Processing, Vol.136, pp.102-106 (2017)
• M. Kobayashi: “Uniqueness Theorem of Complex-Valued Neural Networks with Polar-Represented Activation Function”, IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, Vol.E98-A, No.9, pp.1937-1943 (2015)
• M. Kobayashi, A. Nakajima: “Twisted Quaternary Neural Networks”, IEEJ Transactions on Electrical and Electronic Engineering, Vol.7, No.4, pp.397-401 (2012)
• M. Kobayashi: “Exceptional Reducibility of Complex-Valued Neural Networks”, IEEE Transactions on Neural Networks, Vol.21, No.7, pp.1060-1072 (2010)
• 小林正樹，村松純，山崎晴明: “行列の線形結合による高次元ニューラルネットワーク”, 電子情報通信学会論文誌 A, Vol.J85-A, No.7, pp.763-770 (2002)
  (英訳)
  M. Kobayashi, J. Muramatsu, H. Yamazaki: “Construction of High-Dimensional Neural Networks by Linear Connections of Matrices”, Electronics and Communications in Japan, Part3, Vol.86, No.11, pp.38-45 (2003)

実数型連想記憶

論文

• M. Kobayashi: “Chaotic Pseudo-Orthogonalized Hopfield Associative Memory”, Neurocomputing, Vol.241, pp.147-151 (2017)
• S. Furusawa, M. Kobayashi: “Multidirectional Associative Memory with Self-Connections”, Nonlinear Theory and Its Applications, Vol.5, No.2, pp.222-234 (2014)
• M. Kobayashi, A. Nakajima, M. Kitahara: “Multidirectional Associative Memory with Two Hidden Layers”, IEEJ Transactions on Electrical and Electronic Engineering, Vol.8, No.3, pp.299-300 (2013)
• M. Kobayashi: “Boltzmann Machines with Identified States”, IEICE Transaction on Fundamentals of Electronics, Communications and Computer Sciences, Vol.E91-A, No.3, pp.887-890 (2008)
• 小林正樹，服部元信，山崎晴明: “隠れ層をもつ多方向連想メモリ”, 電子情報通信学会論文誌 D-II, Vol.J84-D-II, No.7, pp.1495-1502 (2001)
  (英訳)
  M. Kobayashi, M. Hattori, H. Yamazaki: “Multidirectional Associative Memory with a Hidden Layer”, Systems and Computers in Japan, Vol.33, No.6, pp.1-9 (2002)

その他

論文

• T. Nitta, M. Kobayashi, D. P. Mandic: “Hypercomplex Widely Linear Estimation through the Lens of Underpinning Geometry”, IEEE Transactions on Signal Processing, Vol.67, No.15, pp.3985-3994 (2019)