The Global Compute-in-Memory Industry: A Strategic Map for a Solo Founder
Where a solo founder actually has leverage in compute-in-memory (CIM/PIM): not silicon, but the missing 'compilation wall' software layer. Maps the global players (d-Matrix $2B, EnCharge, Mythic, IBM NorthPole; China's Witmem/Houmo/Yizhu end-side lead), the seven technology routes, the five investor stages, purchasable dev boards (Axelera Metis from $259, EnCharge EN100, Witmem WTM2101), and a concrete open-source-first entry plan attacking non-ideality-aware calibration and a vendor-agnostic CIM compiler.
Until world models mature, compute-in-memory is one of the more viable hopes for a robot brain.
By Ruoqi Jin — independent researcher (formal architecture descriptors, neuro-symbolic codegen, multi-agent orchestration; 13 years in film post, self-taught into systems since 2024).
Disclaimer: This article aggregates publicly reported research, vendor announcements, and funding data current as of late 2025 / early 2026. Efficiency/performance claims (TOPS/W, "10×", "20×", "150×", "750×") are overwhelmingly vendor-self-reported, often macro-peak or projections, not independently verified full-chip results; market-size figures are forecasts. Chinese round amounts and valuations are largely undisclosed. The reasoning involved AI-assisted generation, has not undergone peer review, and may contain errors. It is aggregated research for personal learning and sharing — not investment advice; investing carries risk.
TL;DR
- The shortest, highest-leverage path for a solo founder is NOT silicon — it is the "compilation wall" (编译墙): the missing CUDA-equivalent software layer (compilers, quantization/non-ideality-aware calibration, model-mapping, runtime/middleware) that every CIM chip vendor lacks and that maps directly onto your compiler/deterministic-codegen background. Build open-source tooling and chip-in-the-loop calibration that targets purchasable dev boards (Axelera Metis M.2 from $259, d-Matrix Corsair, EnCharge EN100, Witmem WTM2101 kits), then monetize via vendor contracts, acquisition, or a niche compiler startup.
- Globally the race is split: the US leads datacenter-scale CIM (d-Matrix at a $2B valuation, EnCharge, Mythic, IBM) while China leads end-side commercialized volume (Witmem shipped ~1 million NOR-Flash CIM SoCs/year; Houmo, Reexen, PIMCHIP in production) but lags in advanced packaging, EDA/software ecosystem, and HBM-PIM. No unified software standard exists anywhere — this is the universal bottleneck.
- CIM is at a commercialization inflection in the low-power edge (TWS, hearing aids, wearables, KWS, edge vision) where 10x energy gains are real and shipping today; datacenter CIM is just entering broad availability (2025–2026) and remains vendor-self-reported on full-chip efficiency. Watch for full-chip (not macro-peak) TOPS/W ≥10x GPU with no accuracy loss, a unified compiler standard, and ReRAM/PCM yield+drift meeting automotive/datacenter reliability as the true inflection signals.
Key Findings
-
The software/compiler layer is the single most under-served, capital-light, high-return entry point, and it is precisely where a solo developer with formal-architecture, deterministic-codegen, and compiler-backend skills has a structural advantage. Every CIM vendor builds a proprietary, incompatible stack (d-Matrix Aviator, Axelera Voyager, EnCharge's suite, Houmo's "Houmo Dadao/后摩大道" toolchain, SK hynix's AiMX/vLLM integration). Academic compilers (CIM-MLC, CINM/Cinnamon, OCC, C4CAM) and simulators (NeuroSim, MICSim, MNSIM, CrossSim, IBM AIHWKit) exist but are fragmented and research-grade.
-
Chip fabrication is the capital trap — tapeouts at 28nm–6nm, ADC/DAC mixed-signal design, advanced 2.5D/3D packaging, and talent run from tens of millions to hundreds of millions of dollars. d-Matrix has raised $450M, EnCharge $144M+, Mythic $266M cumulative, Axelera over $200M plus EU grants. A solo founder cannot and should not compete here.
-
You can buy real CIM hardware today. Axelera Metis M.2 (from $259) and PCIe (from $359) cards ship now with the Voyager SDK; EnCharge EN100 M.2/PCIe is in early-access (Round 2 opening); d-Matrix Corsair has been broadly available since Q2 2025; Witmem WTM2101 dev kits (WTMDK2101-X3/ZT1) are purchasable in China. A developer can start building and benchmarking immediately.
Details
1. Global Players Landscape (2025–2026)
US / Western datacenter-scale:
- d-Matrix (Santa Clara, founded 2019): Digital in-memory compute (DIMC) using modified SRAM. Flagship Corsair PCIe Gen5 card: two chips, 8 chiplets on TSMC 6nm, 2GB SRAM, 256GB LPDDR5X, 2400 TFLOPS 8-bit, 150 TB/s claimed bandwidth, supports OCP Micro-scaling (MX) block-floating-point. Aviator software stack (MLIR-based compiler, PyTorch/Triton integration). Per the company's Nov 12, 2025 release, d-Matrix "closed $275 million in Series C funding, valuing the company at $2 billion and bringing the total raised to date to $450 million," in a round co-led by BullhoundCapital, Triatomic Capital and Temasek, with QIA, EDBI and M12 (Microsoft) participating; SK Hynix and Marvell are strategic backers. Next chip "Raptor" (4nm, 3D-stacked memory) planned. Vendor claims up to 10x speed, 3x TCO, 3x energy efficiency vs GPU (preliminary, self-reported).
- EnCharge AI (Santa Clara, spun from Princeton 2022): Charge-domain analog CIM using metal-layer capacitors + a modified SRAM cell on 16nm; claims >150 TOPS/W (8-bit) test chips, ~40 TOPS/W product, ~30 TOPS/mm². EN100 launched May 2025: M.2 (200+ TOPS, 8.25W, 32GB LPDDR) and PCIe (4 NPUs, ~1 PetaOPS, 40W, 128GB). Per EnCharge's Feb 13, 2025 release it "secured over $100 million in Series B funding...bring[ing] EnCharge AI's total funding to more than $144 million," led by Tiger Global with Samsung Ventures, In-Q-Tel, RTX Ventures and HH-CTBC (Foxconn); the company claims its chips use "up to 20 times less energy to run AI workloads compared to leading AI chips" (self-reported). Early-access program.
- Mythic (founded 2015): Analog CIM in NOR-flash (Mythic AMP/ACE). Restructured 2023, shipped first products late 2023/early 2024. Raised $125M Dec 2025 led by DCVC (with NEA, SoftBank, Honda, Lockheed Martin); $266M cumulative. New CEO Taner Ozcelik (ex-NVIDIA). Claims 120 TOPS/W APU, 17 fJ/MAC, pivoting from edge vision to datacenter + automotive + defense; claims (self-reported) up to 750x tokens/s/W vs top GPUs for 1T-param models.
- Sagence AI (formerly Analog Inference, founded 2018): Deep-subthreshold analog compute in multi-level memory cells. ~$58M raised (Khosla, TDK Ventures, Aramco). Emerged from stealth Nov 2024; claims 10x lower power, 20x lower price vs GPU for Llama2-70B; bringing chips to market in 2025.
- IBM Research: Two tracks. NorthPole (digital near-memory, 12nm, 22B transistors): per IBM Research, on a 3-billion-parameter LLM derived from Granite-8B-Code-Base, NorthPole hit latency below 1 ms/token — "46.9 times faster than the next most energy-efficient GPU" and "72.7 times more energy efficiency than the next lowest latency GPU," reaching "28,356 tokens per second" on a 16-chip 2U server. Research prototype, available for client evaluation. HERMES/Analog AI (PCM-based, 14nm, 64-core mixed-signal): published in Nature Electronics, still research-stage building blocks.
- TetraMem (San Jose, USC/UMass spinout, founders J.J. Yang & Q. Xia): Multi-level ReRAM/memristor analog CIM. Nature 2023 (2,048 conductance levels / 11 bits/cell), Science 2024 (arbitrary high precision). MLX200 22nm RRAM analog IMC SoC taped out (announced 2026); prior MX100 on TSMC 65nm. Commercial NPU in production via foundry. Demonstrated 700°C RRAM operation for extreme environments.
- Untether AI (Toronto, near-memory SRAM digital): acquired June 2025 by Advanced Material Development — a cautionary consolidation signal.
Europe:
- Axelera AI (Eindhoven, NL): Digital in-memory compute (D-IMC) with SRAM crossbars + RISC-V. Metis AIPU: 214 TOPS INT8, ~15 TOPS/W. Per Axelera's official store pricing: M.2 card "From $259.00," PCIe "From $359.00," 4-chip PCIe ~$1,770 (856 TOPS), Metis Compute Board ~$539–757, and pre-built Dell/Lenovo Metis Systems "$999 to $1,999." Voyager SDK (Apache TVM-based; PyTorch/ONNX/TF). M.2 Max (16GB, LLM/VLM) shipping Q4 2025. Next chip Europa (629 TOPS); future Titania (datacenter, €61.6M EuroHPC DARE grant). Raised $250M+ Feb 2026 (Innovation Industries, BlackRock, Samsung Catalyst); $200M+ prior.
Korean memory incumbents (near-memory / PIM):
- Samsung: HBM-PIM (Aquabolt-XL), LPDDR-PIM, CXL-PNM. Focus shifted heavily to HBM3E/HBM4 for the memory super-cycle.
- SK hynix: GDDR6-AiM, AiMX accelerator cards, PIM2-based AiMX3. Live demos at AI Infra Summit 2025 with the vLLM framework and attention-offloading for LLM inference on H100+AiMX heterogeneous systems; developing CXL-based PIM (AI-D B line). Both Korean giants are reallocating ~40% of wafer capacity to HBM, crowding out PIM productization.
- TSMC: SRAM CIM macros (foundry IP, ISSCC research); enabler rather than product vendor.
Chinese players:
- Big-compute (datacenter/auto):
- 后摩智能 (Houmo AI), founded late 2020 by Wu Qiang: SRAM digital CIM, "天枢/天璇" IPU. H30 automotive chip (2023, 12nm, 256 TOPS, 35W, AEC-Q100-qualified, 15 TOPS/W IPU). M50 end-edge large-model chip — per TMTPost (WAIC 2025), released July 2025 with "160 TOPS of INT8 compute and 100 TFLOPS of bFP16 performance, plus up to 48GB of memory and a bandwidth of 153.6 GB/s," running "models from 1.5 billion to 70 billion parameters—all within 10 watts," supported by the "Houmo Dadao" compiler toolchain and LM5050/LM5070 accelerator cards (up to 640 TOPS); mass production Q4 2025 (customers Lenovo, iFlytek, China Mobile). First to mass-produce floating-point CIM (runs FP16 open models without quantization tuning). A DRAM-PIM chip is targeted "as early as 2026" (forward-looking). Funding: angel (tens of M USD, Sequoia China), Pre-A RMB 300M (Qiming), Pre-A+ several hundred M RMB (Matrix/auto fund), 2024 strategic round (China Mobile funds), 2025 China Mobile Capital. Valuation undisclosed.
- 亿铸科技 (Yizhu), founded 2020: ReRAM full-digital big-compute CIM for datacenter; RISC-V integration. Lit up a ReRAM PoC chip 2023; production chip targeted 2025–2026. Funding: angel >RMB 100M (Lenovo Star, CAS), Pre-A >RMB 100M (Longqiu), a several-hundred-M round in 2024, and a new round in Oct 2025 (兴湘, ABC International, 盈科); amounts largely undisclosed. Valuation undisclosed (a 盛视科技 RMB 50M / ~3.35% stake implies roughly RMB 1.5B, but that is third-party inference).
- 千芯科技 (TensorChip), founded 2019: reconfigurable CIM; only one disclosed seed round (tens of M RMB, 2021); least publicly active.
- End-side (small-compute):
- 知存科技 (Witmem), founded 2017: NOR-Flash analog CIM (Computing-in-Flash). WTM2101 (2022) = world's first mass-produced CIM SoC ("up to 50 Gops," RISC-V, 5µA–3mA, 3.2×2.6mm WLCSP); per JW Insights its "annual sales reached one million" units, used in TWS earbuds, hearing aids, and AR glasses (e.g., INMO Air2, lifeme/魅蓝). WTM-8 vision series (24–48 TOPS, trial production); WTM-C edge-server series planned. Series B2 = "RMB200 million ($29.62 million)" on Jan 6, 2023; ~RMB 900M+ raised cumulatively; no new round found 2024–2026.
- 九天睿芯 (Reexen), founded 2018: mixed-signal SRAM-CIM + near-memory, ADC/neuromorphic sense-compute. Chips in mass production for AI glasses/earbuds/hearing aids. B round >RMB 100M (Sept 2025), B+ (Jan 2026).
- 苹芯科技 (PIMCHIP), founded 2021 (chairman Yiran Chen/Duke): SRAM-CIM edge. PIMCHIP-S300/N300 (2024, 28nm, 27 TOPS/W). Raised several rounds of tens-of-M USD (Redpoint, Primavera, Sequoia, ZhenFund).
- 微纳核芯 (Micronano): 3D-CIM; leading the first global RISC-V CIM standard effort with 20+ partners; deep mobile-phone-chip collaboration.
- 安克创新 (Anker) with the Thus chip: NOR-flash CIM AI audio chip fabbed in Germany; debuts in Soundcore Liberty 5 Pro earbuds (Anker Day, May 2026); claims 150x AI compute vs prior earbuds — a notable "application pull" signal of a consumer-electronics company building custom CIM silicon.
- Others: 智芯科 (SRAM CIM image processor), 闪易/新忆科技, 中科声龙 (3D high-throughput).
Academic groups:
- Tsinghua (Wu Huaqiang/Qian He/Gao Bin): world's first fully-integrated memristor (ReRAM) CIM chip supporting on-chip learning (Science 2023, STELLAR algorithm/architecture, ~75x energy efficiency vs ASIC, >95% accuracy, >78 TOPS/W); multimodal optoelectronic memristor arrays (Nature Nanotechnology 2024). Prolific in Nature/Science/Nature Electronics/IEDM/ISSCC.
- Stanford/UCSD/Notre Dame (NeuRRAM, Nature 2022). Princeton (EnCharge origin). USC/UMass (TetraMem origin). ETH Zurich (memory-centric PIM tutorials, Mutlu group). TU Dresden (CINM/Cinnamon compiler).
2. China's Competitive Position
- China LEADS in end-side commercialized CIM volume. Witmem was first to mass-produce a CIM SoC globally (~1M units/year); Reexen, PIMCHIP and Anker are shipping or about to. China benefits from huge application markets (TWS, wearables, smart home, EVs), abundant scenario data, and a "场景驱动" (scenario-driven) culture suited to small-model/edge AI. CIM's low dependence on advanced process nodes is strategically attractive under US export controls — startups deliberately chose CIM/PIM because it avoids leading-edge lithography.
- China LAGS in datacenter-scale CIM and the supporting ecosystem. Weaknesses: limited advanced 2.5D/3D packaging capacity, constrained EDA/foundry access, and — most importantly — a software/ecosystem gap. The "三座大山" (three walls) framing common in Chinese analysis is 存算墙 (memory wall), 能耗墙 (power wall), and 编译墙 (compilation wall). China's base-software ecosystem trails the US, and there is no CUDA-equivalent for CIM anywhere.
- Net assessment: China is ahead on shipping edge volume, roughly level on novel-device research (Tsinghua memristor work is world-class), and behind on datacenter productization, packaging, and software ecosystem. The US/Western lead in big-compute is real (d-Matrix, EnCharge, IBM) but narrow and not yet a moat, because no one has solved software.
3. Technology Routes
- Near-memory computing (HBM-PIM, AiM, GDDR6-AiM): Most mature, closest to deployment; favored by memory incumbents and ecosystem giants. Pros: keeps digital precision, easy to integrate, real bandwidth gains for memory-bound LLM attention/decode. Cons: less radical efficiency gain than true in-memory; depends on HBM capacity (currently constrained). Hardest problems: standardization, host/PIM programming model, thermal.
- SRAM digital CIM: The current productization mainstream (d-Matrix, Axelera, Houmo, Untether). Pros: CMOS-compatible, advanced nodes, fast read/write, ~100% MAC accuracy, no recalibration. Cons: low storage density, high static leakage, SRAM is volatile (weights reloaded). Hardest problems: density/capacity for large models, area cost.
- SRAM analog/charge-domain CIM: EnCharge's differentiator (capacitor charge-domain avoids noisy current summation; voltage output enables SAR ADCs instead of power-hungry transimpedance amps). Pro: very high TOPS/W. Cons: ADC overhead, precision limits, calibration complexity.
- NOR-Flash CIM: Witmem, Mythic, Anker. Pros: non-volatile (weights persist, instant on/off), ultra-low power, low cost, mature. Cons: slow write, limited endurance, analog precision/drift, best for fixed small models. Strong at always-on edge.
- DRAM in/near-memory: High density, suits large models; poor CMOS-logic compatibility. Houmo's DRAM-PIM chip targeted for 2026 (forward-looking).
- ReRAM/memristor CIM: Yizhu, TetraMem, Tsinghua, NeuRRAM. Pros: non-volatile, very high density, 3D-stackable, ~1000x latency-reduction potential, multi-level cells (11 bits demonstrated). Cons: conductance drift, device-to-device variation, write cost, yield immaturity, MAC accuracy ~92–95%. Hardest problems: yield, variation, drift compensation, reliable high-precision programming — the gates to automotive/datacenter use.
- PCM CIM: IBM HERMES/NorthPole-analog. ~97.4% MAC accuracy, multi-level conductance. Cons: drift, write energy, endurance. Research-to-early-product.
- MRAM CIM: Emerging; good endurance/speed, density and multi-level challenges.
Cross-cutting hardest problems: ADC/DAC area-energy overhead (often dominates analog CIM), device non-idealities (drift, variation, noise), and the lack of a software stack to map models while compensating for all of the above.
4. Industry Stages for Investors
- Stage 0 — Device/Material R&D (deep tech, capital-heavy, long): Money → fab access, novel-memory process development, PDKs, characterization. Invest in foundry-partnered teams (Yizhu+昕原, TetraMem+TSMC). Milestone: working multi-level cells with yield/retention data.
- Stage 1 — Macro/PoC silicon (very capital-heavy): Money → tapeouts, ADC/DAC design, test chips, ISSCC/Nature demos. Beware macro-peak TOPS/W ≠ full-chip. Milestone: full-chip silicon with measured (not simulated) efficiency.
- Stage 2 — Product chip + board (capital-heavy): Money → productization, packaging, dev boards, reliability/automotive qualification. Milestone: purchasable card, design wins, MLPerf-style independent benchmarks. (d-Matrix, Axelera, EnCharge are here.)
- Stage 3 — Software/ecosystem (CAPITAL-LIGHT): Money → compilers, quantization/calibration tools, runtime, model zoos, simulators, developer relations. This is where a solo founder or small team can create disproportionate value — and where the whole industry is currently weakest. Milestone: a unified programming interface / CUDA-like standard with multi-vendor adoption.
- Stage 4 — Scale-out / cluster (capital-heavy again): Interconnect (d-Matrix JetStream/SquadRack), system integration, sovereign/hyperscale deployments.
Investor's key lens: fab/tapeout/ADC-DAC/packaging = burn; software/compiler/calibration/tooling = leverage.
5. Commercialization Criteria & Inflection Signals
- Full-chip (not macro-peak) energy efficiency ≥10x GPU with no precision loss on real workloads, independently verified. Watch the gap between headline "TOPS/W" and measured full-system token/s/W.
- Emergence of a unified software stack / compilation standard — a "CUDA for CIM." None exists today; this is the clearest missing inflection marker. The first credible cross-vendor compiler/IR would signal maturity.
- ReRAM/PCM yield, drift, and variation meeting automotive (AEC-Q100) and datacenter reliability. Houmo's H30 already passed AEC-Q100 on SRAM; the harder bar is non-volatile-memory CIM.
- Independent (non-vendor) benchmarks replacing self-reported numbers; design wins at hyperscalers/OEMs; sustained shipment volume.
- Caution on forecasts: Chinese analysts (量子位智库) projected 2025 as an edge-CIM commercialization turning point and a ~10-year path from small- to large-scale production. Market-size figures (e.g., "$12B global CIM market 2025," "RMB 12.5B small-compute market") are projections, not realized revenue.
6. How a Solo Developer / OPC Can Participate (most important)
Verdict: attack the compilation wall with open-source-first software, using purchasable dev boards, monetizing through vendor partnerships and a niche compiler/calibration product.
Why software is the right weak point — and why I'm the one drawing this map. Let me switch to first person for a paragraph, because this map is, honestly, also my own. My background — building an OS from scratch, custom-chip research (ARM + CIM), deterministic compiler backends that constrain LLM code generation, formal architecture descriptors, neuro-symbolic codegen, multi-agent orchestration in Rust — turned out to be an almost one-to-one fit for the hardest unsolved CIM problem: deterministically mapping and scheduling neural networks onto heterogeneous, non-ideal in-memory hardware, with formal guarantees. That overlap is precisely why I went looking, and why I wrote this down. The CIM-MLC and CINM/Cinnamon papers name the open problems plainly: multi-dimensional hardware abstraction, optimal mapping/scheduling across diverse memory devices, and programming interfaces not locked to one chip. These are compiler problems, not silicon problems. So if your background looks anything like mine, the rest of this section is as much a map for you as it was for me.
Concrete entry points, ranked by risk/reward and time-to-value:
-
(Best) Non-ideality-aware quantization + chip-in-the-loop calibration tooling. Build on/around open simulators (NeuroSim V1.5 — now integrates TensorRT PTQ and noise injection; MICSim; CrossSim; IBM AIHWKit) but bridge to real purchasable hardware (Axelera Metis, EnCharge EN100, Witmem). The gap: turning a trained PyTorch/ONNX model into a calibrated, accuracy-preserving deployment on a specific noisy analog/CIM target. Time-to-value: months. Risk: low (works on sub-$400 hardware). Reward: vendor contracts, acquisition, or productized SaaS. This is the shortest path.
-
A vendor-agnostic CIM compiler/IR layer (MLIR-based). A "Triton/MLIR for CIM" abstracting crossbar mapping, ADC partitioning, and scheduling — the would-be CUDA-equivalent. Higher ambition, higher reward; uses your deterministic-codegen and formal-architecture skills. Time-to-value: 12–24 months. Risk: medium (adoption/coopetition — see OpenCL's failure to displace CUDA). Best pursued open-source to win mindshare, then monetize support/optimization.
-
Model optimization / mapping for specific chips as a service. Map customer NNs to crossbar arrays, optimize for a given vendor board, deliver design wins. Low capital, immediate revenue, but less defensible/scalable — good for bootstrapping cash.
-
(Avoid as primary) Hardware/tapeout. Capital-prohibitive for an OPC. Only touch silicon via FPGA prototyping or by partnering.
What you can buy and build on now:
- Axelera Metis M.2 (from $259) / PCIe (from $359) + Voyager SDK — best documented, immediately purchasable, TVM-based (familiar IR); good for edge-vision experiments and compiler hacking.
- EnCharge EN100 M.2/PCIe — analog charge-domain, early-access Round 2; best for AI-PC/on-device LLM efficiency work.
- d-Matrix Corsair + Aviator (MLIR/Triton) — datacenter inference; Aviator's MLIR compiler is an open surface to contribute to or build tooling around.
- Witmem WTM2101 dev kits (WTMDK2101-X3/ZT1) — cheap, China-available, NOR-flash CIM; ideal for always-on voice/KWS/health prototypes.
- Simulators (free, open-source): NeuroSim, MICSim, MNSIM, CrossSim, IBM AIHWKit — start here before buying hardware.
Use scenarios where CIM gives real gains today (build for these):
- Always-on voice/KWS, ANC/noise suppression, health monitoring in TWS/hearables (Witmem, Anker, Reexen — proven 10x+ efficiency, <1mA).
- Wearables/AR glasses, edge vision (Axelera, PIMCHIP).
- AI-PC / on-device LLM inference (EnCharge EN100, Houmo M50).
- Datacenter LLM inference (d-Matrix, SK hynix AiMX) — emerging, larger TAM, more competitive.
Risk/reward summary:
- Software/compiler/calibration: low capital, medium-to-high reward, short-to-medium time — recommended primary.
- Algorithm/quantization research: low capital, medium reward, short time — strong complement.
- Application/integration services: low capital, low-medium reward, immediate cash — good bootstrap.
- Hardware: high capital, high reward, long time — not viable solo.
Recommendations
- Weeks 0–8 (validate, zero hardware spend): Reproduce a CIM mapping/quantization flow in NeuroSim V1.5 + IBM AIHWKit. Pick one model class you know (small transformer or KWS net) and quantify the accuracy-vs-noise tradeoff. Publish code/findings openly to build credibility. Trigger to proceed: if you cannot reproduce published accuracy under injected non-idealities, the calibration gap is real and addressable.
- Months 2–4 (buy in cheap): Acquire an Axelera Metis M.2 (from $259) and a Witmem WTM2101 kit. Build a chip-in-the-loop calibration tool that takes a PyTorch/ONNX model and produces an accuracy-preserving deployment, measuring real full-chip token/s/W (not vendor peak). Open-source the core — this is your wedge.
- Months 4–9 (productize the wedge): Extend to a second target (EnCharge EN100 early-access or d-Matrix Aviator/MLIR contributions). Generalize toward a vendor-agnostic mapping IR. Approach 1–2 vendors for paid integration/consulting — they all lack software headcount.
- Months 9–18 (monetize/scale): Choose between (a) an open-core compiler startup with paid optimization/support, (b) acqui-hire/contract with a vendor, or (c) a focused quantization-calibration SaaS. Threshold to commit full-time: a paying vendor pilot, OR an open-source project with multi-vendor traction, OR a measured, reproducible full-chip efficiency win on purchasable hardware.
- Continuous signal-watching (change-of-course triggers): If a credible unified CIM compiler standard emerges from a major (NVIDIA, an OCP working group, or a vendor consortium), pivot from "build the standard" to "build on/around it." If non-volatile-memory CIM (ReRAM/PCM) hits automotive/datacenter yield+drift bars, the big-compute TAM opens and tooling for those targets gains value. If the edge CIM market consolidates (à la Untether's acquisition), prioritize the surviving vendors' stacks.
Caveats
- Efficiency/performance claims (TOPS/W, "20x," "100x," "150x," "750x," "10x") are overwhelmingly vendor-self-reported and often macro-peak or projection, not independently verified full-chip results. Treat d-Matrix's "10x/3x," EnCharge's "20x," Mythic's "100x/750x," and Anker's "150x" as marketing until MLPerf-style third-party data confirms.
- The field moves extremely fast; all funding/availability data is time-stamped to late-2025/early-2026 and will shift. Chinese round amounts/valuations are largely undisclosed ("数亿元/超亿元" = amounts not precisely revealed).
- Market-size numbers are forecasts, not realized revenue, and sources vary widely.
- No unified CIM software standard exists as of this writing — both the central opportunity and a sign the field is pre-inflection; betting on tooling carries adoption/coopetition risk (cf. OpenCL).
- Houmo's reported 2026 科创板 IPO and profit projections are unverified stock-forum speculation, not confirmed.
- Some company/product details (exact EN100 early-access timing, Sagence go-to-market) are vendor announcements that may slip.
About the author: Ruoqi Jin, independent researcher — formal architecture descriptors (Forge, arXiv:2604.13108), neuro-symbolic code generation (Neural-Codegen), multi-agent orchestration (MissionD, 111K lines of Rust). 33, 13 years in film post-production, self-taught into Rust/compilers/distributed systems since 2024.
Disclaimer: aggregated search-based research, AI-assisted, not peer-reviewed and possibly containing errors; for personal learning and sharing only — not investment advice. Investing carries risk; enter the market with caution.