Skip to main content
Nvdium.
LatestTechnologyFinanceWeb3
Markets
01 / CREDITCredit RadarTreasury curves, stress indexes, auctions, and corporate credit events and debt issuance from SEC filings.02 / PREDICTIONPrediction market boardPolymarket prices for markets Nvdium monitors. Prices are not facts or probability guarantees.03 / ON-CHAINWhale RadarLarge on-chain flows and signals, with backtests and sources.04 / EARNINGSEarnings calendarEarnings dates across major markets with watchlists.
Every data point carries its source and observation date.All market desks ↗
HomeLatestTechnologyFinanceWeb3Markets

Sections

  • Home
  • Latest
  • Technology
  • Finance
  • Web3

Tools

  • Markets
  • Prediction markets
  • Credit risk
  • Earnings
  • Whale Radar
NEWSLETTER

Get the signals worth reading in your inbox

By subscribing, you agree to our privacy policy.
NvdiumMake valuable technology information easier to discover.[email protected]© 2026 Nvdium
AboutCopyrightPrivacyComplaintsRSS
HomeLatestMarketsWhalesSearch

Sections

  • Home
  • Latest
  • Technology
  • Finance
  • Web3

Tools

  • Markets
  • Prediction markets
  • Credit risk
  • Earnings
  • Whale Radar
Author

Dmitry Soldatkin

4 public articles
Artificial intelligence

Introducing Amazon SageMaker HyperPod Global Inference Gateway: One endpoint across Regions and clusters

DDmitry Soldatkin·Nov 21, 2026, 06:35 AM·12 min read

The gist: Amazon SageMaker HyperPod introduces the Global Inference Gateway, one managed endpoint that routes inference requests across your HyperPod clusters in one Region or across Regions. It picks the best cluster, fails over automatically, and authenticates every request with SigV4 and IAM over AWS PrivateLink.

Artificial intelligence

Keep inference running through regional capacity shortfalls with cross-Region inference routing in Amazon SageMaker AI

DDmitry Soldatkin·Nov 20, 2026, 02:20 AM·16 min read

The gist: Cross-Region inference routing in Amazon SageMaker AI gives your application one invocation path across the endpoints and inference components you already run, in one or more AWS Regions and AWS accounts. The router prefers its own Region and shifts new requests to another destination only when the local one can't serv

Artificial intelligence

Amazon SageMaker AI real-time endpoints now support KV cache aware routing

DDmitry Soldatkin·Nov 18, 2026, 05:11 AM·20 min read

The gist: Amazon SageMaker AI real-time endpoints now support KV cache-aware routing, a new strategy that routes each request to the instance holding the longest cached match for its prompt. Learn how it works, when to use it compared with prefix-aware routing, and how to enable, invoke, and verify it on single model and inferen

Artificial intelligence

Deploying Qwen3.8-2.4T-A95B on Amazon SageMaker HyperPod with vLLM

DDmitry Soldatkin·Sep 10, 2026, 06:26 AM·18 min read

The gist: Learn how to deploy Qwen3.8-2.4T-A95B, a 2.4-trillion-parameter open-weight model, on Amazon SageMaker HyperPod with vLLM. This walkthrough covers cluster provisioning, NVFP4 quantization, and an OpenAI-compatible endpoint with built-in reasoning, tool calling, and native MTP speculative decoding.

All articles loaded
POPULAR NOW

Hot ranking

  1. 1
  2. 2
  3. 3
  4. 4
  5. 5
  6. 6
  7. 7
  8. 8
  9. 9
  10. 10
POPULAR NOW

Hot ranking

  1. 01Review: Godzilla Minus Zero is everything we could want in a sequel
  2. 02Amazon is complaining about NYC Council on shipping labels, too
  3. 03The UN fails to agree on rules regulating ‘killer robots’
  4. 04The FBI and USDA were reportedly hacked
  5. 05Amazon Takes $120 Off 46mm GPS Apple Watch Series 12 With New Record Low Price
  6. 06Apple Store in UK Permanently Closing Today
  7. 07Siri AI Settlement: Here's How Much Apple Will Pay You
  8. 08RIP, Apple Support Community
  9. 09Amazon’s first digital photo frame is up to 50 percent off for Black Friday
  10. 10John Roberts, the voice of Linda Belcher, is just happy to finish a thing