Exploring Fractional-Order Gradient Descent Algorithms for Neural Networks

This research delves into fractional-order gradient descent algorithms, implementing various optimizers, and evaluating their impact on GPT model training. Discover the innovative mathematical framework and preliminary findings that could redefine optimization techniques in machine learning.

5/8/20241 min read

Fluid, abstract shapes with smooth curves and dynamic lines, featuring a blend of warm and cool tones.
Fluid, abstract shapes with smooth curves and dynamic lines, featuring a blend of warm and cool tones.

Fractional-Order Optimization

Research

Exploring fractional-order algorithms for neural networks.

© 2025. All rights reserved.