Friday, April 07, 2023

AI may not exactly follow your instructions! But that is Ok.

A Large Learning Model uses AI/Machine Learning to recognize the data presented to it and connect the dots. Sometimes using initiative to add to your prompt.

Here is an example. 

I am sitting in the library and these are the actual pictures.


I use the Bing Image Creator powered by Dall-E to give it this prompt. 
I am sitting in a library and working on my laptop, The laptop is in front of me as I type. To my left is the laptop's power cord and below it is my phone that is charging. on my right is a mousepad with my mouse and in front of it is a water bottle that is made of steel and has a blue top. The table I am sitting on has 5 chairs all spread out across the table. On the chair next to me is my backpack. I am Indian and I am wearing a black jacket as it is a bit cold here.

Here are the images that I get back.





The additions in the image that I did not mention were - notebooks, blue chairs in the library, and the position of the mouse. The laptop bag is not on the chair. 

My Observations:

  • It got the place library right, books, bookshelves, chairs. It has enough data to recognize the visual components of the library
  • Telling the AI that I am an Indian meant that I had to accept what the Ai thinks is a consolidation of what it has learned as photos of people from India. I did not say if I am a boy or a girl but the model may have information from my profile or not.
  • Waterbottle is a no brainer
  • The model has not learned what a "on the chair next to me is my laptop bag" There may not be many photos in the learning data about this scene
I think both Microsoft, Open AI, and Google are throttling back some of the capabilities as it may be easy to improve the results of my prompt by adding more learning. I think the concern is if the model returns results too close to reality there may be a lot of anxiety about what could happen next. 

Bard's Response:

It sounds like you are working hard in the library. I hope you are finding it a quiet and productive place to work.

I can picture you sitting at a table with your laptop in front of you. To your left is the laptop's power cord, and below it is your phone that is charging. On your right is a mousepad with your mouse, and in front of it is a water bottle that is made of steel and has a blue top. The table you are sitting at has 5 chairs, all spread out across the table. On the chair next to you is your backpack. You are Indian, and you are wearing a black jacket as it is a bit cold here.

I hope you have a great day!


 

 



No comments:

AI generated summary of 60 minutes AI edition

In a 60 Minutes interview that aired on April 17, 2023, Google CEO Sundar Pichai warned that artificial intelligence (AI) is advancing rapid...