4 ms·

Where are the AI features in Firefox? Looking around right now the only one I see is right click tab -> Summarize page (NEW). I googled a bit and see they have

by ddxv 8mo ago

Where are the AI features in Firefox? Looking around right now the only one I see is right click tab -> Summarize page (NEW). I googled a bit and see they have some grouping of tabs feature I've never used/seen (or want). The only other maybe AI feature I remember seeing is the odd left hand bar that is there on fresh installs and I usually remove to declutter. Are those the features this kill switch removes or was there a deeper issue here?

godelski 8mo ago
There's also a side window you can open that can connect to a chatbot. There's translation (on device). Also semantic history search.
mrklol 8mo ago
Firefox mentions the following ones: "- Translations, which help you browse the web in your preferred language. - Alt text in PDFs, which add accessibility descriptions to images in PDF pages. - AI-enhanced tab grouping, which suggests related tabs and group names. - Link previews, which show key points before you open a link. - AI chatbot in the sidebar, which lets you use your chosen chatbot as you browse, including options like Anthropic Claude, ChatGPT, Microsoft Copilot, Google Gemini and Le Chat Mistral."
- mort96 8mo ago
  I wonder what sort of user testing made them decide that what Firefox users really need is a chat bot in the site bar. Isn't a chat bot in a tab good enough? And calling translation "AI" seems like deceitful retroactive rebranding. Why is machine translation suddenly "AI" now? It was never branded as such before. Is "AI" here just used to mean machine learning?
  - johnnyanmac 8mo ago
    Wouldn't be the first time. Google gave an option to turn off gemini in Gmail, and suddenly the inbox tabs they had for over a decade decided to disappear.
  - input_sh 8mo ago
    IMHO no. Every chatbot has so much wasted space, it really doesn't need to be full-width. Also, what's easier? Option 1: Being on a tab, copying the URL of the tab, switching to the chatbot tab, pasting the URL and writing some instructions about what to do with that tab. Option 2: Clicking on the "summarise page" button (whether from the sidebar or from right-click context menu), and having the browser pre-fill the prompt with the URL + the reader view version of the content on that page.
    - mort96 8mo ago
      Option 3: don't
      - input_sh 8mo ago
        Then you right-click on the AI button and click on "remove", but that's a whole different discussion than what you asked in the previous comment. It's also why I really don't understand the need for a kill switch to begin with (other than pleasing annoying users), you don't need to wait for it. You can already get rid of the chatbot integration, there's a remove button already. It's also kind of annoyingly easy to misclick it, so they're just gonna remove it from those places and put it away in settings and those same annoying users will consider that a win.
        mort96 8mo ago
        Why can't you people who want a ChatGPT sidebar just add that as a plugin?
        input_sh 8mo ago
        "You people"? Take a look at my comment history and see my takes on AI please, but this is like the least harmful way of integrating it and yet "you people" are the loudest about it. Can you do the same on Windows? Is it tucked away in settings on macOS? Can you disable it on Google? Can you disable it anywhere else? Why are you the most vocal about the integration that is literally the easiest to turn off? You need two clicks to do it right now, you're gonna need at least three once this kill switch is in settings.
  - jeppester 8mo ago
    > I wonder what sort of user testing made them decide that what Firefox users really need is a chat bot in the site bar. Isn't a chat bot in a tab good enough? If it wasn't because I find myself using the AI-sidebar all the time I would probably have shared your opinion. I guess it's just quite convenient to have it separated from the "regular" tabs and their history.
    - mort96 8mo ago
      Then you can install an AI extension.
      - jeppester 8mo ago
        You were saying: > I wonder what sort of user testing made them decide that what Firefox users really need is a chat bot in the site bar I answered: > If it wasn't because I find myself using the AI-sidebar all the time I would probably have shared your opinion. Perhaps they did actually test it. Perhaps the majority is like me and find it useful. > Then you can install an AI extension. As mentioned I didn't know that I'd like this feature. I wouldn't have reached for such an extension. It's obvious that you don't want this functionality - which you can now easily disable. What if the majority of the users actually like this? Or the majority either like it or are not the slightest bothered by it? Is it not a good addition overall then?
    - UI_at_80x24 8mo ago
      Could you please describe your use-case? How do you use it? How do you make use of it? I use Claude code, so I understand that paradigm; I don't grok this though. Is it any different then going to a web page i.e. gemini.google.com and typing your query there? Could this side bar have been a "search bar" at the top? Now that I say it out lou, adding them to the 'search providers' isn't a bad idea. Generally speaking I am against this being shoved at us, but I find it as a useful tool in a limited number of areas.
      - jeppester 8mo ago
        I always have my browser open, so having it just one click away and not interrupting with whatever else the browser is showing feels convenient. I'm using linux, so there are no official desktop apps I could use instead. Had there been, perhaps I'd have had a different opinion about the AI sidebar.
  - throwawayk7h 8mo ago
    I saw someone else using this feature. It does more than just be a chat bot. You can direct it to automate tasks like go to a web page, search for stuff, etc. -- I asked it to go to pinterest and download the top ten images for "cyberpunk," and it succeeded. Nifty I suppose.
    - dormento 8mo ago
      As much as i detest everything about it, i must admit i'm mildly curious as to what workflows people are using it for.
  - lynndotpy 8mo ago
    "AI" is a term which means a dozen things and has changed a dozen times. It's about as meaningful a signifier as "smart". If I were to draw a line, I'd say AI is anything with a transformer model powering it. As exhausted by 'AI' as I am, translation is one of the things neural networks (and especially transformers) have been constantly improving SOTA on.
  - AndrewDucker 8mo ago
    They use a Neural Network engine to power it. That definitely counts as AI: https://aclanthology.org/P18-4020/ https://aclanthology.org/P18-4020/
  - wongarsu 8mo ago
    The word artificial intelligence was coined in a 1955 research proposal [1] which listed seven aspects of the "artificial intelligence problem". Computers using languages was one of them. Another is "neuron nets", which would indeed encompass a large part of ML and at least Google Translate since circa 2016 [2]. This is also perfectly in line with how the word AI was used until circa 2022. The weird thing is this narrowing of AI to only mean transformer or diffusion based neural network approaches. And many translation approaches would even fall under that, so not sure how narrow you perceive the term to be now. How do you even define AI to include everything OpenAI calls AI but not include modern translation approaches 1: https://www-formal.stanford.edu/jmc/history/dartmouth/dartmouth.html https://www-formal.stanford.edu/jmc/history/dartmouth/dartmo... 2: https://web.archive.org/web/20180507195240/https://ai.googleblog.com/2016/09/a-neural-network-for-machine.html https://web.archive.org/web/20180507195240/https://ai.google...
    - squeefers 8mo ago
      > This is also perfectly in line with how the word AI was used until circa 2022. show me a screenshot or link of one website or app using AI to mean machine translation from prior to 2022, AI has re-entered the lexicon covering anything from an algorithm to Sora. if anything its broadened, not narrowed in scope. me and you might mean transformer when we say AI, but the average speaker doesnt make that distinction. they call video sites "social media", so can you really be surprised they dont quite use AI correctly either?
      - Volundr 8mo ago
        Here you go: https://web.archive.org/web/20200929085743/https://en.wikipedia.org/wiki/Google_Translate https://web.archive.org/web/20200929085743/https://en.wikipe... Admittedly I don't think this uses the term AI, but "deep learning" and "artificial neural network" are indeed AI, and if you follow those links in the Wikipedia article you will indeed find them described as such.
        squeefers 8mo ago
        i agree, but the guy said AI was a synonym for machine translation long before the currently confused meaning appeared
  - nsvd2 8mo ago
    The transformer architecture that powers large language models was designed by Google for the purposes of machine translation. As others have said, ML and AI have always been closely related if not synonymous.
  - Dwedit 8mo ago
    I've run an AI translation tool under a debugger just to see what it did. It tokenized your input, fed it into a model, then ran the model. Literally the same thing as any other local AI software. Except the model was for translation.
  - deleted 8mo ago
    [deleted]
  - stonogo 8mo ago
    Firefox's translation specifically is from Project Bergamot: https://browser.mt/ https://browser.mt/ It's a set of language models in the style that people currently call AI.
  - AdmiralAsshat 8mo ago
    It is annoying. LLMs are not AI, and on-device translations are one of the few genuinely useful features Firefox has shipped in the past few years.
    - sigmar 8mo ago
      LLMs are definitely AI. All neural networks are a subset of AI. LLMs use transformer architecture within a neural network.
- Spixel_ 8mo ago
  They all seem like great features.
  - mrweasel 8mo ago
    On paper yes. The problem is that they clutter the UI, they trigger at weird times and they turn out to be less useful that they may appear. Then there's also people, like me, who just want the browser to browse the web. I don't want link preview (annoying feature), Firefox isn't my PDF viewer, I don't have that many tabs that I need to group them and I don't use AI chatbots. So having a single button to disable all of these features is pretty great. I still want a Firefox Lite, that just does browsing and allows me to add the few extension I want to whatever feature I believe is missing.
    - pamcake 8mo ago
      You might like Konform Browser. Optional features like that disabled with the nag removed (but local ones can still be enabled in preferences). https://codeberg.org/konform-browser/source https://codeberg.org/konform-browser/source
  - MallocVoidstar 8mo ago
    I started clicking a 'next page' link before I'd actually finished reading something (so I kept holding the mouse buttown down), and a couple of seconds later Firefox popped up a 'link preview' box informing me that I was clicking on a link to a web forum. Wow, thanks, couldn't have figured that out myself. (It did not actually summarize the next page in any way.)
- techwizrd 8mo ago
  Whoa, I have been looking for AI-enhanced tab grouping for a while. This is actually pretty awesome.
- badsectoracula 8mo ago
  > AI chatbot in the sidebar, which lets you use your chosen chatbot as you browse, including options like Anthropic Claude, ChatGPT, Microsoft Copilot, Google Gemini and Le Chat Mistral." When i saw this i expected something more... integrated, but when i tried it with a local LLM (using koboldcpp) after enabling the option to show localhost as an option (it is hidden by default for some reason) all it did was to local whatever webpage was running on the localhost URL (even though koboldcpp also provides an OpenAI compatible endpoint, which is what i expected Firefox to use to provide its own UI). It seems to have some sort of heuristic to find the input box where you type in queries and autofills that with the page text or parts of it (if you have it selected) and that's all. I kinda expected it instead to use the API endpoint, have its own chat UI, provide MCP tools for accessing and manipulating the page's content, let you create reusable prompts, etc. The current solution feels like something you'd throw together in a weekend at most.
  - skywhopper 8mo ago
    The chatbot providers don’t allow any cleaner integration unless you are using pay-per-request API rates.
    - badsectoracula 8mo ago
      This is not a problem for local LLMs though - and AFAIK Firefox does require from you to login to the cloud chatbots, so you'd probably be the one getting charged for it.
gpvos 8mo ago
Page translation is mentioned in TFA. It appears in the address bar on pages detected to be in a foreign language, and is also in the main hamburger menu.
- pamcake 8mo ago
  Recently I also discovered about:translations. Dunno why it's hidden from about:about.
  - deltoidmaximus 8mo ago
    Wow, didn't know about this thanks. The translation feature should be entirely offline and actually predates the AI everything push. I think it's a great feature.
vitorgrs 8mo ago
Lol. At first I was thinking it was a AI kill switch on web pages (like Google overview...). I guess was being naive that they would do that, and also weird because there's barely any AI stuff on Firefox indeed...
on_the_train 8mo ago
YouTube is completely broken with this shitty spark thing. Also yesterday I was greeted with an entire new sidebar. It's comical
koolala 8mo ago
Ever see colored circles in your tabs?
- ddxv 8mo ago
  No, I don't think I have?
fleebee 8mo ago
I get some kind of AI summary when I do a long left click on a link. I'm sure I'm not the only one to accidentally trigger that one.
skywhopper 8mo ago
More are coming, so it’s important to have a single clear toggle for this that respects user preferences.

by ddxv 8mo ago

godelski 8mo ago

There's also a side window you can open that can connect to a chatbot. There's translation (on device). Also semantic history search.

mrklol 8mo ago

Firefox mentions the following ones: "- Translations, which help you browse the web in your preferred language. - Alt text in PDFs, which add accessibility descriptions to images in PDF pages. - AI-enhanced tab grouping, which suggests related tabs and group names. - Link previews, which show key points before you open a link. - AI chatbot in the sidebar, which lets you use your chosen chatbot as you browse, including options like Anthropic Claude, ChatGPT, Microsoft Copilot, Google Gemini and Le Chat Mistral."

mort96 8mo ago
I wonder what sort of user testing made them decide that what Firefox users really need is a chat bot in the site bar. Isn't a chat bot in a tab good enough? And calling translation "AI" seems like deceitful retroactive rebranding. Why is machine translation suddenly "AI" now? It was never branded as such before. Is "AI" here just used to mean machine learning?
- johnnyanmac 8mo ago
  Wouldn't be the first time. Google gave an option to turn off gemini in Gmail, and suddenly the inbox tabs they had for over a decade decided to disappear.
- input_sh 8mo ago
  IMHO no. Every chatbot has so much wasted space, it really doesn't need to be full-width. Also, what's easier? Option 1: Being on a tab, copying the URL of the tab, switching to the chatbot tab, pasting the URL and writing some instructions about what to do with that tab. Option 2: Clicking on the "summarise page" button (whether from the sidebar or from right-click context menu), and having the browser pre-fill the prompt with the URL + the reader view version of the content on that page.
  - mort96 8mo ago
    Option 3: don't
    - input_sh 8mo ago
      Then you right-click on the AI button and click on "remove", but that's a whole different discussion than what you asked in the previous comment. It's also why I really don't understand the need for a kill switch to begin with (other than pleasing annoying users), you don't need to wait for it. You can already get rid of the chatbot integration, there's a remove button already. It's also kind of annoyingly easy to misclick it, so they're just gonna remove it from those places and put it away in settings and those same annoying users will consider that a win.
      - mort96 8mo ago
        Why can't you people who want a ChatGPT sidebar just add that as a plugin?
        input_sh 8mo ago
        "You people"? Take a look at my comment history and see my takes on AI please, but this is like the least harmful way of integrating it and yet "you people" are the loudest about it. Can you do the same on Windows? Is it tucked away in settings on macOS? Can you disable it on Google? Can you disable it anywhere else? Why are you the most vocal about the integration that is literally the easiest to turn off? You need two clicks to do it right now, you're gonna need at least three once this kill switch is in settings.
- jeppester 8mo ago
  > I wonder what sort of user testing made them decide that what Firefox users really need is a chat bot in the site bar. Isn't a chat bot in a tab good enough? If it wasn't because I find myself using the AI-sidebar all the time I would probably have shared your opinion. I guess it's just quite convenient to have it separated from the "regular" tabs and their history.
  - mort96 8mo ago
    Then you can install an AI extension.
    - jeppester 8mo ago
      You were saying: > I wonder what sort of user testing made them decide that what Firefox users really need is a chat bot in the site bar I answered: > If it wasn't because I find myself using the AI-sidebar all the time I would probably have shared your opinion. Perhaps they did actually test it. Perhaps the majority is like me and find it useful. > Then you can install an AI extension. As mentioned I didn't know that I'd like this feature. I wouldn't have reached for such an extension. It's obvious that you don't want this functionality - which you can now easily disable. What if the majority of the users actually like this? Or the majority either like it or are not the slightest bothered by it? Is it not a good addition overall then?
  - UI_at_80x24 8mo ago
    Could you please describe your use-case? How do you use it? How do you make use of it? I use Claude code, so I understand that paradigm; I don't grok this though. Is it any different then going to a web page i.e. gemini.google.com and typing your query there? Could this side bar have been a "search bar" at the top? Now that I say it out lou, adding them to the 'search providers' isn't a bad idea. Generally speaking I am against this being shoved at us, but I find it as a useful tool in a limited number of areas.
    - jeppester 8mo ago
      I always have my browser open, so having it just one click away and not interrupting with whatever else the browser is showing feels convenient. I'm using linux, so there are no official desktop apps I could use instead. Had there been, perhaps I'd have had a different opinion about the AI sidebar.
- throwawayk7h 8mo ago
  I saw someone else using this feature. It does more than just be a chat bot. You can direct it to automate tasks like go to a web page, search for stuff, etc. -- I asked it to go to pinterest and download the top ten images for "cyberpunk," and it succeeded. Nifty I suppose.
  - dormento 8mo ago
    As much as i detest everything about it, i must admit i'm mildly curious as to what workflows people are using it for.
- lynndotpy 8mo ago
  "AI" is a term which means a dozen things and has changed a dozen times. It's about as meaningful a signifier as "smart". If I were to draw a line, I'd say AI is anything with a transformer model powering it. As exhausted by 'AI' as I am, translation is one of the things neural networks (and especially transformers) have been constantly improving SOTA on.
- AndrewDucker 8mo ago
  They use a Neural Network engine to power it. That definitely counts as AI: https://aclanthology.org/P18-4020/ https://aclanthology.org/P18-4020/
- wongarsu 8mo ago
  The word artificial intelligence was coined in a 1955 research proposal [1] which listed seven aspects of the "artificial intelligence problem". Computers using languages was one of them. Another is "neuron nets", which would indeed encompass a large part of ML and at least Google Translate since circa 2016 [2]. This is also perfectly in line with how the word AI was used until circa 2022. The weird thing is this narrowing of AI to only mean transformer or diffusion based neural network approaches. And many translation approaches would even fall under that, so not sure how narrow you perceive the term to be now. How do you even define AI to include everything OpenAI calls AI but not include modern translation approaches 1: https://www-formal.stanford.edu/jmc/history/dartmouth/dartmouth.html https://www-formal.stanford.edu/jmc/history/dartmouth/dartmo... 2: https://web.archive.org/web/20180507195240/https://ai.googleblog.com/2016/09/a-neural-network-for-machine.html https://web.archive.org/web/20180507195240/https://ai.google...
  - squeefers 8mo ago
    > This is also perfectly in line with how the word AI was used until circa 2022. show me a screenshot or link of one website or app using AI to mean machine translation from prior to 2022, AI has re-entered the lexicon covering anything from an algorithm to Sora. if anything its broadened, not narrowed in scope. me and you might mean transformer when we say AI, but the average speaker doesnt make that distinction. they call video sites "social media", so can you really be surprised they dont quite use AI correctly either?
    - Volundr 8mo ago
      Here you go: https://web.archive.org/web/20200929085743/https://en.wikipedia.org/wiki/Google_Translate https://web.archive.org/web/20200929085743/https://en.wikipe... Admittedly I don't think this uses the term AI, but "deep learning" and "artificial neural network" are indeed AI, and if you follow those links in the Wikipedia article you will indeed find them described as such.
      - squeefers 8mo ago
        i agree, but the guy said AI was a synonym for machine translation long before the currently confused meaning appeared
- nsvd2 8mo ago
  The transformer architecture that powers large language models was designed by Google for the purposes of machine translation. As others have said, ML and AI have always been closely related if not synonymous.
- Dwedit 8mo ago
  I've run an AI translation tool under a debugger just to see what it did. It tokenized your input, fed it into a model, then ran the model. Literally the same thing as any other local AI software. Except the model was for translation.
- deleted 8mo ago
  [deleted]
- stonogo 8mo ago
  Firefox's translation specifically is from Project Bergamot: https://browser.mt/ https://browser.mt/ It's a set of language models in the style that people currently call AI.
- AdmiralAsshat 8mo ago
  It is annoying. LLMs are not AI, and on-device translations are one of the few genuinely useful features Firefox has shipped in the past few years.
  - sigmar 8mo ago
    LLMs are definitely AI. All neural networks are a subset of AI. LLMs use transformer architecture within a neural network.
Spixel_ 8mo ago
They all seem like great features.
- mrweasel 8mo ago
  On paper yes. The problem is that they clutter the UI, they trigger at weird times and they turn out to be less useful that they may appear. Then there's also people, like me, who just want the browser to browse the web. I don't want link preview (annoying feature), Firefox isn't my PDF viewer, I don't have that many tabs that I need to group them and I don't use AI chatbots. So having a single button to disable all of these features is pretty great. I still want a Firefox Lite, that just does browsing and allows me to add the few extension I want to whatever feature I believe is missing.
  - pamcake 8mo ago
    You might like Konform Browser. Optional features like that disabled with the nag removed (but local ones can still be enabled in preferences). https://codeberg.org/konform-browser/source https://codeberg.org/konform-browser/source
- MallocVoidstar 8mo ago
  I started clicking a 'next page' link before I'd actually finished reading something (so I kept holding the mouse buttown down), and a couple of seconds later Firefox popped up a 'link preview' box informing me that I was clicking on a link to a web forum. Wow, thanks, couldn't have figured that out myself. (It did not actually summarize the next page in any way.)
techwizrd 8mo ago
Whoa, I have been looking for AI-enhanced tab grouping for a while. This is actually pretty awesome.
badsectoracula 8mo ago
> AI chatbot in the sidebar, which lets you use your chosen chatbot as you browse, including options like Anthropic Claude, ChatGPT, Microsoft Copilot, Google Gemini and Le Chat Mistral." When i saw this i expected something more... integrated, but when i tried it with a local LLM (using koboldcpp) after enabling the option to show localhost as an option (it is hidden by default for some reason) all it did was to local whatever webpage was running on the localhost URL (even though koboldcpp also provides an OpenAI compatible endpoint, which is what i expected Firefox to use to provide its own UI). It seems to have some sort of heuristic to find the input box where you type in queries and autofills that with the page text or parts of it (if you have it selected) and that's all. I kinda expected it instead to use the API endpoint, have its own chat UI, provide MCP tools for accessing and manipulating the page's content, let you create reusable prompts, etc. The current solution feels like something you'd throw together in a weekend at most.
- skywhopper 8mo ago
  The chatbot providers don’t allow any cleaner integration unless you are using pay-per-request API rates.
  - badsectoracula 8mo ago
    This is not a problem for local LLMs though - and AFAIK Firefox does require from you to login to the cloud chatbots, so you'd probably be the one getting charged for it.

gpvos 8mo ago

Page translation is mentioned in TFA. It appears in the address bar on pages detected to be in a foreign language, and is also in the main hamburger menu.

pamcake 8mo ago
Recently I also discovered about:translations. Dunno why it's hidden from about:about.
- deltoidmaximus 8mo ago
  Wow, didn't know about this thanks. The translation feature should be entirely offline and actually predates the AI everything push. I think it's a great feature.

vitorgrs 8mo ago

Lol. At first I was thinking it was a AI kill switch on web pages (like Google overview...). I guess was being naive that they would do that, and also weird because there's barely any AI stuff on Firefox indeed...

on_the_train 8mo ago

YouTube is completely broken with this shitty spark thing. Also yesterday I was greeted with an entire new sidebar. It's comical

koolala 8mo ago

Ever see colored circles in your tabs?

ddxv 8mo ago
No, I don't think I have?

fleebee 8mo ago

I get some kind of AI summary when I do a long left click on a link. I'm sure I'm not the only one to accidentally trigger that one.

skywhopper 8mo ago

More are coming, so it’s important to have a single clear toggle for this that respects user preferences.