Posts: 27,398
   
Threads: 8,092
    
Likes Received: 4,687 in 3,701 posts
Likes Given: 661
I, being poor, have only my dreams; I have spread my dreams under your feet; Tread softly because you tread on my dreams.
>
(This post was last modified: 13-08-2021, 04:17 PM by
sgbuffett.)
Posts: 27,398
   
Threads: 8,092
    
Likes Received: 4,687 in 3,701 posts
Likes Given: 661
I already used GAN to generate all.sorts of pictures....
Any other advances in AI interesting to learn?
I, being poor, have only my dreams; I have spread my dreams under your feet; Tread softly because you tread on my dreams.
>
Posts: 8,038
   
Threads: 17
    
Likes Received: 1,563 in 1,315 posts
Likes Given: 521
how to automate and optimise the nn structures for a particular problem? and let them adapt when new data comes in? instead of guessing and trying the number of layers, number of neurons, their interconnections, learning rate, momentum rate, activation functions and etc.
in other words, how to let the nn learn to learn, optimise and adapt, all by themselves, no trial and error
Posts: 7,203
   
Threads: 2,821
    
Likes Received: 2,353 in 1,732 posts
Likes Given: 1
(13-08-2021, 04:19 PM)sgbuffett Wrote: I already used GAN to generate all.sorts of pictures....
Any other advances in AI interesting to learn?
Posts: 27,398
   
Threads: 8,092
    
Likes Received: 4,687 in 3,701 posts
Likes Given: 661
(13-08-2021, 04:45 PM)WhatDoYouThink? Wrote: how to automate and optimise the nn structures for a particular problem? and let them adapt when new data comes in? instead of guessing and trying the number of layers, number of neurons, their interconnections, learning rate, momentum rate, activation functions and etc.
in other words, how to let the nn learn to learn, optimise and adapt, all by themselves, no trial and error
I have already thought through this problem.
Any problem space the NN is to discover generalisations e.g. what are the charactiestsixs makes a dog a dog.
The difficult of this is unknown until you run it through an NN ..if N layers is not enough add another layer until you get accuracy you want.
So one needs to figure out the "ease of generalisation" to determine the structure of the network needed.
I can do this by measuring the error vector of after training an X(say 3) layer NN.
and using the error distribution I trained another network to predict the #of layers needed to achieve a desired error.
I, being poor, have only my dreams; I have spread my dreams under your feet; Tread softly because you tread on my dreams.
>
Posts: 8,038
   
Threads: 17
    
Likes Received: 1,563 in 1,315 posts
Likes Given: 521
(13-08-2021, 05:37 PM)sgbuffett Wrote: I have already thought through this problem.
Any problem space the NN is to discover generalisations e.g. what are the charactiestsixs makes a dog a dog.
The difficult of this is unknown until you run it through an NN ..if N layers is not enough add another layer until you get accuracy you want.
So one needs to figure out the "ease of generalisation" to determine the structure of the network needed.
I can do this by measuring the error vector of after training an X(say 3) layer NN.
and using the error distribution I trained another network to predict the #of layers needed to achieve a desired error.
that's only the numbers of layers. still got numbers of neurons, their interconnections (mostly used all-to-all), ...... a lot of guess work and not optimised
Users browsing this thread: