7 ms·
Hardware is the new software
- threepipeproblm 9y ago"absent improvements in microarchitecture they [CPUs] won’t be substantially faster, nor substantially more power efficient, and they will have about the same number of cores at the same price point as prior CPUs. Why would anyone buy a new CPU?"
- deleted 9y ago[deleted]
- amelius 9y agoWhy don't we see CPUs with an integrated FPGA yet?
- pjc50 9y ago- No popular applications that use this yet (see history of 3D graphics) - Tooling is terrible and non-free - Power consumption - Tiny die area FPGA not that useful, huge die FPGA is wasting die you could use for cache - Cost of the nonintegrated solution is huge e.g. http://www.nallatech.com/store/fpga-accelerated-computing/pcie-accelerator-cards/nallatech-385a-arria10-1150-fpga/ http://www.nallatech.com/store/fpga-accelerated-computing/pc...
- Eridrus 9y agoCould FPGA be configured as cache out of the box, or is there too much overhead for this to be at all meaningful?
- detaro 9y agoToo much overhead. FPGAs normally have dedicated memory blocks, since making memory out of "normal" logic cells needs way to much space (registers, temporary buffers for single values, ... can often be embedded in the logic design, but not larger blocks of memory)
- dfox 9y agoThe synthesis tools even try wery hard to optimize dumb registers away from your design (you typically blow away ~40 gate equivalents for one bit of simple memory implemented by logic cell). While having clock-gated registers makes the design harder to understand and thus is undesirable, another reason why it is undesirable is that it tends to break any such optimizations performed by synthesis toolchain.
- javiramos 9y agoI want to emphasize the Tooling is terrible and non-free It is really hard to get a young programmer excited about programming FPGAs when the tools are archaic, buggy, proprietary, and non-portable. The higher-level interfaces (C abstractions etc.) are also lacking.
- cobookman 9y ago+1 vhdl is much harder to reason about than c. With fpgas you don't write a code flow, instead you write logic that gets executed all at the same time. It's good for things that are compute heavy, but not for anything else. I'd also wager that asics might make more sense than fpgas. Which seems to be the path we are going down
- tnecniv 9y agoVHDL (or Verilog) isn't harder to reason about than C in my experience, it's just different.
- Jtsummers 9y agoI haven't used VHDL for work yet (just skimmed the existing code base), but I just took a course on it, this was my main takeaway. There were some gotchas in the language (perhaps in the error reporting in the particular implementation more than the language itself) that took some getting used to, but the hardest conceptual problem for the class (most of us were programmers, and the hardware guys were green and came from non-CMPE backgrounds) was the idea that many of the statements you write happen concurrently, or are scheduled to happen at a future point in the code. So code like: process begin X <= X + 1; Y <= X; end process; With X = 4 at the start, you will end up with (X,Y) = (5,4). Once you start wrapping your head around these concepts reasoning isn't so hard (and having been a CMPE major once I had the basis for this academically, but it was far in the past so had been forgotten). Certainly not harder than trying to understand distributed systems and coordination between them, in fact it's a lot of the same problems just applied at a different scale.
- pjc50 9y agoAdded to this list: - most programmers have a poor grasp on what the real advantages and disadvantages of FPGAs are, instead treating them as magic sauce - you need to go and benchmark: https://electronics.stackexchange.com/questions/140618/can-fpga-out-perform-a-multi-core-pc/140623#140623 https://electronics.stackexchange.com/questions/140618/can-f... also https://electronics.stackexchange.com/questions/132034/how-can-a-microcontroller-be-more-efficient-than-an-fpga/132037#132037 https://electronics.stackexchange.com/questions/132034/how-c... Commercially they're mostly used for low-latency predictable-throughput signal processing.
- sitkack 9y agoWhat if you could make the FPGA and the cache the same thing? FPGAs, CPUs and GPUs are all merging into a computational goo. DSPs already got handed their asses by the FPGA vendors including hard blocks for multipliers. That was all it took to kill the entire arch.
- unwind 9y agoFor Intel, I guess no clear business case, or something. Integrating FPGA support with operating systems seems like an interesting problem too, and perhaps one which needs some effort before desktop/server systems add this. In the embedded world they're available and not even super new, the Zynq[1] from Xilinx has been out for a few years. It combines an FPGA fabric with hard ARM CPU core(s). Intel (through the acquisition of Altera) also has such products, like Stratix[1] which also combines FPGA and ARM. I seem to remember seing some x86+FPGA for embedded applications from Intel, but didn't find it with a quick search. [1] https://www.xilinx.com/products/silicon-devices/soc/zynq-7000.html https://www.xilinx.com/products/silicon-devices/soc/zynq-700... [2] https://www.altera.com/products/soc/portfolio/stratix-10-soc/overview.html https://www.altera.com/products/soc/portfolio/stratix-10-soc...
- lloydjatkinson 9y ago> In the embedded world they're available and not even super new, I feel you might be understating this! FPGA's and ASIC's have in fact been in use for decades now, they are very much ingrained into many high end products. Any digital oscilloscope has an FPGA, and has done for a very long time, for example. These are often either used in combination with a CPU for the UI part. The CPU might either be an IC on the PCB or what is quite popular is having the CPU be a synthesised one programmed into the FPGA. ARM, for example, have a whole architecture specifically designed for optimal FPGA synthesis. There are a number of relatively cheap SBC's out there with an FPGA too. http://linuxgizmos.com/tiny-sbc-runs-linux-on-xilinx-zynq-arm-fpga/ http://linuxgizmos.com/tiny-sbc-runs-linux-on-xilinx-zynq-ar...
- gbrown_ 9y ago> I seem to remember seing some x86+FPGA for embedded applications from Intel, but didn't find it with a quick search. I suspect these have gone out to "select customers". https://www.theregister.co.uk/2016/03/14/intel_xeon_fpga/ https://www.theregister.co.uk/2016/03/14/intel_xeon_fpga/
- aseipp 9y agoThe Stratix/Arria series are ungodly expensive, however. The low-end ARM/FPGA combo series for Intel is the Cyclone V[1], which is much closer in specs/capabilities to the ordinary Zynq platforms. [1]http://www.terasic.com.tw/cgi-bin/page/archive.pl?Language=English&CategoryNo=205&No=1046 http://www.terasic.com.tw/cgi-bin/page/archive.pl?Language=E...
- Shikadi 9y agoIntel is working on that, it's most of why they bought Altera
- jerf 9y agoWhen a problem that seems like it might drive FPGA adoption becomes sufficiently popular, it gets dedicated hardware instead. That's why we have GPUs, AES instructions, and CPU-hardware-based random number generators, and not onboard FPGAs. FPGAs basically get evaporatively-cooled out of the CPU.
- amelius 9y agoOk, but what happened to "general purpose computing"?
- detaro 9y agoOn CPUs the end of Moore's law, but having dedicated accelerators for special tasks is not exactly new. And they free up the general-purpose resources to do things that actually require them, instead of wasting time and heat budget on easily-optimized tasks.
- jerf 9y agoI don't understand the question. Unless you are using word-thinking and think that "general purpose computing" is some sort of promise that the maximally-general-purpose hardware is guaranteed to be available, in accordance with some particular ideosyncratic definition of "maximally general purpose hardware"? General purpose computing refers more to your ability to run any program you choose rather than particular hardware capabilities. It stands in opposition to platfroms where the programs are locked down, like gaming consoles.
- pjc50 9y agoThat's what graphics cards are for. /joking, mostly
- irq-1 9y ago> [when] FPGA adoption becomes sufficiently popular, it gets dedicated hardware instead. I always thought this too, but turn around time (time to market) in hardware isn't fast enough, and as the article argues, Intel has a vested interest in adding instructions. Most large companies are motivated to add complexity and keep the users spending their time on the companies projects. It doesn't pay to make simpler products that might become commodities. Examples that I don't think would move from FPGA to CPU: - Specialized algorithims that don't have enough users. - Changing algorithims: encryption, HTTP2 parser, data structure/index scanning - Tied to specific software: a game that's popular, but not enough to justify CPU instructions - Portable FPGA: imagine an M.2 or USB style connection fast enough to run an add-on FPGA. It could be the start of making a reconfigurable computer; just add the chips for your software.
- westbywest 9y agoBesides reasons already mentioned above (and adding my own emphasis on suboptimal power performance), CPUs have GHz-scale clock domains, thanks to pipeline stages that minimize the number of gates traversed on each cycle. FPGA designs often run at frequencies ~10x slower. While one could instantiate pipeline stages using FPGA's logic calls, it's badly inefficient use of silicon. Maintaining separate clock domains, on the other hand, also consumes lots of silicon due to needing to isolate the domains, to avoid injecting noise into shared power/ground planes.
- danellis 9y agoCypress PSoC?
- aseipp 9y agoThe SmartFusion2 from Microsemi is also a contender for Cortex-M based FPGA/CPU combination boards, on the extreme low end. I haven't used a Cypress yet. (The SF2 dev kits actually come with about 25k logic cells, which is a fair amount for such a small board with an M3).
- gricardo99 9y agoWith things like AWS F1 instances[1], it seems anyone who wants to experiment with, or make production use of FPGA accelerated computing can do so without a large capital or time investment in the hardware platform itself. That being said, as many others have pointed out in this thread, there are still tool-chain and conceptual hurdles to doing this effectively. If/when FPGA acceleration becomes more common-place, I think you'll see tighter integration of the FPGA with the server hardware platforms, perhaps to the point of it being on-package, if not on-die. The demand of the marketplace will dictate the pace and level of integration. That is of course also if the major CPU makers are in-tune and responsive to these market demands. I wouldn't be shocked if Amazon, Google, etc... were designing their own server CPU chipsets from scratch, to include some features they can't get from Intel/AMD. But at least with the Intel acquisitions of Nervana[2] and Altera[3], I'd say Intel seems to be aware of evolving computing needs. But the major data center operators have been building their own solutions further up the "hardware stack" for some time. Amazon, Facebook and Google have bypassed the major equipment makers (Dell, HP, Cisco, EMC, etc...) and gone ahead with their own server and switch hardware designs to suite their specific datacenter needs[4]. 1 - https://aws.amazon.com/ec2/instance-types/f1/ https://aws.amazon.com/ec2/instance-types/f1/ 2 - https://www.recode.net/2016/8/9/12413600/intel-buys-nervana--350-million https://www.recode.net/2016/8/9/12413600/intel-buys-nervana-... 3 - https://newsroom.intel.com/news-releases/intel-completes-acquisition-of-altera/ https://newsroom.intel.com/news-releases/intel-completes-acq... 4 - https://www.wired.com/2016/03/google-facebook-designing-open-source-data-center-gear-together/ https://www.wired.com/2016/03/google-facebook-designing-open...
- lend000 9y agoIntel is slowly getting on board. The Altera acquisition was likely geared toward this, and they already had reconfigurable "coprocessors" on certain products. See US20170090956A1
- irishjohnnie 9y agoYou mean like Xilinx's Zynq? https://www.xilinx.com/products/silicon-devices/soc/zynq-7000.html https://www.xilinx.com/products/silicon-devices/soc/zynq-700...
- Gracana 9y agoUsually it's the other way around. That is, FPGAs with onboard hard CPU cores. Great for making custom SoCs.
- pkaye 9y agoXilinx and Altera have/had FPGAs with CPUs (ARM and PPC I think.)
- anon6353 9y ago>A careful reading of Intel patents suggests that SGX >instructions are implemented entirely in microcode. If new >ISA features are new microcode, that opens up the >possibility of supporting them on existing CPUs. The SGX instructions are essentially key management for full memory encryption. Does he really think memory encryption could be implemented in microcode? That's an obvious flaw of his proposal. I'm really surprised no paper reviewer caught that. What happened to peer review?
- pjc50 9y ago> Does he really think memory encryption could be implemented in microcode? Yes? Why not? This argument rather relies on knowing what the (trade secret) capabilities of the microcode are. I don't see why this warrants a smear on peer review.
- locacorten 9y agoThe argument the paper makes does not rest on whether memory encryption is implemented solely in microcode. All the problems with SGX lie with its management part not with the encryption part. I'm referring to side-channel attacks and lack of secure counters. If you read the paper carefully, there are many other arguments one can make against it. However, it is an interesting paper and its message is worth considering. Peer-review is not a perfect process. I think the research community is better off with publishing such a paper.
- Animats 9y agoTailfins for CPUs. Do not want. MIPS did something like that. Each MIPS variant required different compiler flags to get good performance. Software distribution was a huge pain, with multiple versions. MIPS peaked in the 1990s.