• Good old ReLU. I’ve heard that CNN’s perform better when using ReLU as the activation func, and that’s probably why; ReLU acts as a filter on the image’s features.

        • Nah. Without a nonlinearity you just get a linear combination of inputs instead of the output of a deep neural network. ReLU or Ramp is just the simplest possible non linearity. Using a simple function can enable using deeper networks yielding even better performance.

          It’s actually somewhat of a headache, numerically. Works well enough tho.

    • Had one guy asking if AI is conscious. I said the whole thing is actually one very big excel sheet, so does he think that excel can be conscious? Anyway, I think the guy is now in a relationship with office.

    • Yes, it is inherently incorrect, I just think that increases the fun factor. It reminds me of that guy who wrote a prime-checker for his thesis and it was just a massive list of if-statement

      • 98% accurate prime checker, super fast

        isPrime() return False;

          • 7 days

            Boolean math let’s you convert it all to nand gates. For ease of manufacturing this is what is done.

    • Matrix multiplication, activation functions and softmax. Also some matrix addition sometimes. That’s literally it

      • I mean yeah, the mechanism itself is straightforward, but isn’t a big thing that we don’t really know what it chooses for its… basis vectors? Something. Like that, I don’t do programming and I’m out of practice with matrices

  • The human brain is far too complex to understand

    looks inside

    it’s just meat

  • That was old AI.

    New AI uses a complex, multi-layer sequence of Magic 8-balls.

    • That’s a common misconception. It is a complex multi-layer sequence of heavily biased Magic 8-balls.

    • I wouldn’t be surprised if some stuff (as in architecture) was solved by querying a different model to solve a problem

    • I would be heavily more inclined to use LLMs (and also probably use it in a more correct manner) if it came in the physical form of a magic 8-ball that I would violently shake to get the answer.

  • You don’t have to be an AI developer to not understand your code. I not understand my code every day.

    • You’re forgetting the activation function to break linearity, otherwise you can only model linear trends. Many activation functions have “if” hidden in them (e.g. ReLU with the “max”).

  • Have you ever tried to follow five hundred nested for loop and if statements? Shit is nuts…

    • Oh, just wait till you hit that sweet sweet python “Everything can have an else block”

      if some_shit:
          try: 
              for stuff in thing:
                   if stuff is bad:
                        raise ShitHitTheFanError
                   # Massive block comment
                   do = the_thing()
                   if do is good:
                        break
              else:
                  do = the_other_thing()
                  if not a_thing:
                      help_me() # May raise NoHelpFoundError
          except ShitHitTheFanError:
               my_life = recover()
               if my_life is bad:
                   for fuck in my_life:
                        try:
                            fix(fuck)
                        except NoHelpFoundError:
                            break
                   else:
                        fuck_this_shit()
          else:
               wat_is_going_on()
      else:
          theres_another_one("?")
      
      • I’m a network engineer lol python is all I know… and yup, the else is a curve ball from hell

        But this is absolutely fucking hilarious

    • Conway’s Game of Life is Turing Complete and that fact has been fucking with my mind for like 25 years.

  • ml is not a hard coded set of if-else pairs. it’s a glorified fit with a lot of parameters.

  • repeat that for like one hundred billion times and now THAT’s innovation