4 ms·

Can you give me a little more specific detail on your use cases that fail with 3.5 and succeed with 4? I've tried to get some projects going using the API to ge

• mewpmewp2 2y ago
  One example is a prompt like: Find inconsistencies with data that should be structured in a certain way (...data...), give me JSON response of actions to fix the data. GPT-3.5 gives pointless things, very rarely any of the important things, or simply makes up things, while GPT-4 seems to spot everything at least on the data I provide. What is the geometric data you generate?
  • uejfiweun 2y ago
    Thank you for the examples. I definitely haven't used it much for that type of use case but I'll keep that in mind. I don't want to give up too much info about my project because it would probably dox me, but it essentially involves generating consistent geometric shapes in a 2d array. Like the following: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 0 0 0 1 1 1 0 0 0 1 1 1 0 Both current flavors of GPT are unable to generate spatially consistent shapes according to my specifications. Who knows, maybe they will improve in this realm in GPT-5 with the inclusion of their rumored Q* algorithm.
    • mewpmewp2 2y ago
      I imagine that I would want to ask for this output differently, as a function that would output this rather than it to write out those tokens. For example: Give a JavaScript function that will output 0 and 1 tokens to render a rectangle on a 2d array. Example output: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 0 0 0 1 1 1 0 0 0 1 1 1 0 It responded: function generateRectangle(rows, cols, rectStartRow, rectStartCol, rectHeight, rectWidth) { // Create a 2D array filled with 0s let array = Array.from({ length: rows }, () => Array(cols).fill(0)); // Fill the rectangle area with 1s for (let i = rectStartRow; i < rectStartRow + rectHeight; i++) { for (let j = rectStartCol; j < rectStartCol + rectWidth; j++) { array[i][j] = 1; } } return array; } function printArray(array) { array.forEach(row => { console.log(row.join(' ')); }); } // Example usage: let rows = 5; let cols = 6; let rectStartRow = 2; let rectStartCol = 2; let rectHeight = 3; let rectWidth = 3; let rectangleArray = generateRectangle(rows, cols, rectStartRow, rectStartCol, rectHeight, rectWidth); printArray(rectangleArray); ------ And then I asked for a triangle instead, but still with square output example ----- function generateTriangle() { const size = 10; const field = Array.from({ length: size }, () => Array(size).fill(0)); for (let i = 0; i < size; i++) { for (let j = 0; j <= i; j++) { field[size - 1 - i][j] = 1; } } return field; } function printField(field) { for (let row of field) { console.log(row.join(' ')); } } const triangleField = generateTriangle(); printField(triangleField); 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 1 1 0 0 0 0 0 0 0 1 1 1 0 0 0 0 0 0 1 1 1 1 0 0 0 0 0 1 1 1 1 1 0 0 0 0 1 1 1 1 1 1 0 0 0 1 1 1 1 1 1 1 0 0 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 ---- Then I would execute the function programmatically to generate these tokens.
      • uejfiweun 2y ago
        Huh. Very interesting idea, I didn't even think to approach the prompt this way. I'm gonna try this out and report back. Thanks!
• mewpmewp2 2y ago
  I created a very simple example if you want to test - to me that's an amazing leap: *Find inconsistencies in the following:* The car started driving with 50l in tank. Car drove 10km. Car uses 2l per km. Car had 10l of fuel left. *GPT-3.5 responds:* > There are no inconsistencies in the given information. *GPT-4:* > Let's analyze the information provided: 1. The car started with 50 liters of fuel in the tank. 2. The car drove 10 kilometers, and it uses 2 liters of fuel per kilometer. To calculate the amount of fuel used: Fuel used = Distance driven × Fuel consumption per km Fuel used = 10 km × 2 l/km = 20 liters Now, let's calculate the remaining fuel after driving 10 kilometers: Remaining fuel = Initial fuel - Fuel used Remaining fuel = 50 liters - 20 liters = 30 liters However, it is stated that the car had 10 liters of fuel left, which is inconsistent with the calculation. Based on the given fuel consumption and distance driven, the car should have 30 liters left, not 10 liters. This is the inconsistency in the information provided.
  • anon373839 2y ago
    Llama 3 8B provides this answer: > Let's break down the information: 1. The car started with 50L (liters) of fuel in the tank. 2. The car drove 10km. 3. The car uses 2L per km. To find inconsistencies, let's calculate how much fuel was consumed during the drive: Distance driven = 10km Fuel consumption per km = 2L/km Total fuel consumed = Distance driven x Fuel consumption per km = 10km x 2L/km = 20L Now, let's compare this with the initial amount of fuel in the tank (50L) and the remaining fuel after driving (10L): Initial fuel = 50L Fuel consumed = 20L Remaining fuel = 10L The inconsistency is that the car cannot have 10L of fuel left if it started with 50L and used 20L during the drive. The correct calculation would be: Remaining fuel = Initial fuel - Fuel consumed = 50L - 20L = 30L So, the car should have 30L of fuel left, not 10L.