Descriptor multivista de activaciones neuronales, mediante la fusión de grafos funcionales y homología persistente

Autores/as

DOI:

https://doi.org/10.70577/cieninter.v4i4.162

Palabras clave:

Análisis topológico de datos, Aprendizaje profundo, Aprendizaje multivista, Homología persistente, Interpretabilidad.

Resumen

La presente investigación propone un descriptor multivista de las activaciones internas de las redes neuronales, es decir, un conjunto fijo de números que resume una red y combina dos descripciones distintas del mismo objeto, una basada en métricas de teoría de grafos sobre la conectividad entre neuronas y otra en la homología persistente, que resume la forma de la nube de activaciones. Para su validación se emplearon cuarenta redes neuronales de dos tipos, perceptrones multicapa y convolucionales, distribuidas en cinco grupos y entrenadas en tres conjuntos de imágenes. La variable independiente es el grupo de cada red, y las dependientes son los números que el descriptor calcula para ella (diez medidas del grafo, doce estadísticos de persistencia y su fusión), sin usar la exactitud. La fusión proporcionó resultados altamente significativos en cuanto a funcionamiento y predicción, coincidencia y rendimiento, mediante validación cruzada (0,949, 0,957 y 0,972 en los tres conjuntos), contrastes no paramétricos (29 de 30 pruebas significativas) y el análisis ROC (0,949 con la fusión, 0,854 y 0,869 con cada vista y 0,754 con una línea base), respectivamente. Como los dos tipos de red difieren mucho en exactitud, dos comprobaciones adicionales, una restringida a los perceptrones multicapa y otra que igualó la exactitud dentro de cada tipo, mostraron que la ventaja del descriptor no depende de esa diferencia.

Descargas

Los datos de descargas todavía no están disponibles.

Citas

Alain, G., y Bengio, Y. (2016). Understanding intermediate layers using linear classifier probes. arXiv preprint arXiv:1610.01644. https://doi.org/10.48550/arXiv.1610.01644

Arlot, S., y Celisse, A. (2010). A survey of cross-validation procedures for model selection. Statistics Surveys, 4, 40–79. https://doi.org/10.1214/09-SS054 DOI: https://doi.org/10.1214/09-SS054

Ballester, R., Arnal Clemente, X., Casacuberta, C., Madadi, M., Corneanu, C. A., y Escalera, S. (2024). Predicting the generalization gap in neural networks using topological data analysis. Neurocomputing, 596, 127787. https://doi.org/10.1016/j.neucom.2024.127787 DOI: https://doi.org/10.1016/j.neucom.2024.127787

Ballester, R., Casacuberta, C., y Escalera, S. (2026). Topological data analysis for neural networks. Springer. https://doi.org/10.1007/978-3-032-08283-1 DOI: https://doi.org/10.1007/978-3-032-08283-1

Baltrusaitis, T., Ahuja, C., y Morency, L. P. (2019). Multimodal machine learning: A survey and taxonomy. IEEE Transactions on Pattern Analysis and Machine Intelligence, 41(2), 423–443. https://doi.org/10.1109/TPAMI.2018.2798607 DOI: https://doi.org/10.1109/TPAMI.2018.2798607

Bauer, U. (2021). Ripser: efficient computation of Vietoris–Rips persistence barcodes. Journal of Applied and Computational Topology, 5, 391–423. https://doi.org/10.1007/s41468-021-00071-5 DOI: https://doi.org/10.1007/s41468-021-00071-5

Benjamini, Y., y Hochberg, Y. (1995). Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society: Series B, 57(1), 289–300. https://doi.org/10.1111/j.2517-6161.1995.tb02031.x DOI: https://doi.org/10.1111/j.2517-6161.1995.tb02031.x

Bullmore, E., y Sporns, O. (2009). Complex brain networks: graph theoretical analysis of structural and functional systems. Nature Reviews Neuroscience, 10(3), 186–198. https://doi.org/10.1038/nrn2575 DOI: https://doi.org/10.1038/nrn2575

Chazal, F., y Michel, B. (2021). An introduction to topological data analysis: fundamental and practical aspects for data scientists. Frontiers in Artificial Intelligence, 4, 667963. https://doi.org/10.3389/frai.2021.667963 DOI: https://doi.org/10.3389/frai.2021.667963

Chen, Z., Fu, L., Yao, J., Guo, W., Plant, C., y Wang, S. (2023). Learnable graph convolutional network and feature fusion for multi-view learning. Information Fusion, 95, 109–119. https://doi.org/10.1016/j.inffus.2023.02.013 DOI: https://doi.org/10.1016/j.inffus.2023.02.013

Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences (2.ª ed.). Lawrence Erlbaum Associates. https://doi.org/10.4324/9780203771587 DOI: https://doi.org/10.4324/9780203771587

Corneanu, C. A., Escalera, S., y Martinez, A. M. (2020). Computing the testing error without a testing set. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2674–2682. https://doi.org/10.1109/CVPR42600.2020.00275 DOI: https://doi.org/10.1109/CVPR42600.2020.00275

Demsar, J. (2006). Statistical comparisons of classifiers over multiple data sets. Journal of Machine Learning Research, 7, 1–30. https://jmlr.org/papers/v7/demsar06a.html

Edelsbrunner, H., Letscher, D., y Zomorodian, A. (2002). Topological persistence and simplification. Discrete & Computational Geometry, 28(4), 511–533. https://doi.org/10.1007/s00454-002-2885-2 DOI: https://doi.org/10.1007/s00454-002-2885-2

García, S., Fernández, A., Luengo, J., y Herrera, F. (2010). Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: Experimental analysis of power. Information Sciences, 180(10), 2044–2064. https://doi.org/10.1016/j.ins.2009.12.010 DOI: https://doi.org/10.1016/j.ins.2009.12.010

Hao, P., Gao, W., y Hu, L. (2025). Embedded feature fusion for multi-view multi-label feature selection. Pattern Recognition, 157, 110888. https://doi.org/10.1016/j.patcog.2024.110888 DOI: https://doi.org/10.1016/j.patcog.2024.110888

Hoerl, A. E., y Kennard, R. W. (1970). Ridge Regression: Biased Estimation for Nonorthogonal Problems. Technometrics, 12(1), 55–67. https://doi.org/10.1080/00401706.1970.10488634 DOI: https://doi.org/10.1080/00401706.1970.10488634

Horta, V. A. C., Tiddi, I., Little, S., y Mileo, A. (2021). Extracting knowledge from deep neural networks through graph analysis. Future Generation Computer Systems, 120, 109–118. https://doi.org/10.1016/j.future.2021.02.009 DOI: https://doi.org/10.1016/j.future.2021.02.009

Kendall, M. G. (1938). A new measure of rank correlation. Biometrika, 30(1/2), 81–93. https://doi.org/10.2307/2332226 DOI: https://doi.org/10.1093/biomet/30.1-2.81

Klabunde, M., Schumacher, T., Strohmaier, M., y Lemmerich, F. (2025). Similarity of neural network models: A survey of functional and representational measures. ACM Computing Surveys, 57(9), 1–52. https://doi.org/10.1145/3728458 DOI: https://doi.org/10.1145/3728458

Krizhevsky, A. (2009). Learning Multiple Layers of Features from Tiny Images. https://www.cs.toronto.edu/~kriz/learning-features-2009-TR.pdf

Liang, P. P., Zadeh, A., y Morency, L. P. (2024). Foundations & trends in multimodal machine learning: Principles, challenges, and open questions. ACM Computing Surveys, 56(10), 1–42. https://doi.org/10.1145/3656580 DOI: https://doi.org/10.1145/3656580

Loshchilov, I., y Hutter, F. (2019). Decoupled weight decay regularization. International Conference on Learning Representations (ICLR). https://openreview.net/forum?id=Bkg6RiCqY7

Mann, H. B., y Whitney, D. R. (1947). On a test of whether one of two random variables is stochastically larger than the other. The Annals of Mathematical Statistics, 18(1), 50–60. https://doi.org/10.1214/aoms/1177730491 DOI: https://doi.org/10.1214/aoms/1177730491

Mellor, J., Turner, J., Storkey, A., y Crowley, E. J. (2021). Neural architecture search without training. Proceedings of the 38th International Conference on Machine Learning (ICML), 7588–7598. https://proceedings.mlr.press/v139/mellor21a.html

Moor, M., Horn, M., Rieck, B., y Borgwardt, K. (2020). Topological autoencoders. Proceedings of the 37th International Conference on Machine Learning (ICML), 7045–7054. https://proceedings.mlr.press/v119/moor20a.html

Naitzat, G., Zhitnikov, A., y Lim, L. H. (2020). Topology of deep neural networks. Journal of Machine Learning Research, 21(184), 1–40. https://jmlr.org/papers/v21/20-345.html

Netzer, Y., Wang, T., Coates, A., Bissacco, A., Wu, B., y Ng, A. Y. (2011). Reading digits in natural images with unsupervised feature learning. NIPS Workshop on Deep Learning and Unsupervised Feature Learning. http://ufldl.stanford.edu/housenumbers/nips2011_housenumbers.pdf

Purvine, E., Brown, D., Jefferson, B., Joslyn, C., Praggastis, B., Rathore, A., Shapiro, M., Wang, B., y Zhou, Y. (2023). Experimental observations of the topology of convolutional neural network activations. Proceedings of the AAAI Conference on Artificial Intelligence, 37(8), 9470–9479. https://doi.org/10.1609/aaai.v37i8.26134 DOI: https://doi.org/10.1609/aaai.v37i8.26134

Raghu, M., Gilmer, J., Yosinski, J., y Sohl-Dickstein, J. (2017). SVCCA: Singular vector canonical correlation analysis for deep learning dynamics and interpretability. Advances in Neural Information Processing Systems (NeurIPS), 6076–6085. https://proceedings.neurips.cc/paper/2017/hash/dc6a7e655d7e5840e66733e9ee67cc69-Abstract.html

Recht, B., Roelofs, R., Schmidt, L., y Shankar, V. (2019). Do ImageNet classifiers generalize to ImageNet?. Proceedings of the 36th International Conference on Machine Learning (ICML), 5389–5400. https://proceedings.mlr.press/v97/recht19a.html

Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., y Batra, D. (2017). Grad-CAM: Visual explanations from deep networks via gradient-based localization. Proceedings of the IEEE International Conference on Computer Vision (ICCV), 618–626. https://doi.org/10.1109/ICCV.2017.74 DOI: https://doi.org/10.1109/ICCV.2017.74

Simonyan, K., Vedaldi, A., y Zisserman, A. (2013). Deep inside convolutional networks: Visualising image classification models and saliency maps. arXiv preprint arXiv:1312.6034. https://doi.org/10.48550/arXiv.1312.6034

Songdechakraiwut, T., y Wu, Y. (2025). Functional Connectomes of Neural Networks. Proceedings of the AAAI Conference on Artificial Intelligence (AAAI-25), 20558–20566. https://doi.org/10.1609/aaai.v39i19.34265 DOI: https://doi.org/10.1609/aaai.v39i19.34265

Sun, S. (2013). A survey of multi-view machine learning. Neural Computing and Applications, 23(7–8), 2031–2038. https://doi.org/10.1007/s00521-013-1362-6 DOI: https://doi.org/10.1007/s00521-013-1362-6

Zhang, B., Dong, Z., Zhang, J., y Lin, H. (2023). Functional network: A novel framework for interpretability of deep neural networks. Neurocomputing, 519, 94–103. https://doi.org/10.1016/j.neucom.2022.11.035 DOI: https://doi.org/10.1016/j.neucom.2022.11.035

Zhang, B., He, Z., y Lin, H. (2024). A comprehensive review of deep neural network interpretation using topological data analysis. Neurocomputing, 609, 128513. https://doi.org/10.1016/j.neucom.2024.128513 DOI: https://doi.org/10.1016/j.neucom.2024.128513

Zhang, B., y Lin, H. (2024). Functional loops: Monitoring functional organization of deep neural networks using algebraic topology. Neural Networks, 174, 106239. https://doi.org/10.1016/j.neunet.2024.106239 DOI: https://doi.org/10.1016/j.neunet.2024.106239

Zhao, J., Xie, X., Xu, X., y Sun, S. (2017). Multi-view learning overview: Recent progress and new challenges. Information Fusion, 38, 43–54. https://doi.org/10.1016/j.inffus.2017.02.007 DOI: https://doi.org/10.1016/j.inffus.2017.02.007

Descargas

Publicado

2026-11-11

Cómo citar

Reinoso Reinoso, C. D., & Escudero Villa, A. I. (2026). Descriptor multivista de activaciones neuronales, mediante la fusión de grafos funcionales y homología persistente. Ciencia Interdisciplinaria Internacional, 4(4), 234–252. https://doi.org/10.70577/cieninter.v4i4.162

Artículos similares

1 2 3 4 5 6 7 8 9 10 > >> 

También puede Iniciar una búsqueda de similitud avanzada para este artículo.