<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>AI Archives | Cloudar</title>
	<atom:link href="https://cloudar.be/case-studies/ai/feed/" rel="self" type="application/rss+xml" />
	<link>https://cloudar.be/case-studies/ai/</link>
	<description>100% Focus On AWS // 100% Customer Obsession</description>
	<lastBuildDate>Thu, 09 Jul 2026 05:51:59 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.0.1</generator>
	<item>
		<title>FinAIOps: Why Token Economics Will Define Your AI Operations</title>
		<link>https://cloudar.be/awsblog/finaiops-token-economics/</link>
		
		<dc:creator><![CDATA[Tom De Blende]]></dc:creator>
		<pubDate>Thu, 09 Jul 2026 05:51:59 +0000</pubDate>
				<category><![CDATA[AI]]></category>
		<category><![CDATA[AWS]]></category>
		<category><![CDATA[AWS Blog]]></category>
		<category><![CDATA[FinOps]]></category>
		<category><![CDATA[Well-Architected]]></category>
		<category><![CDATA[Bedrock]]></category>
		<category><![CDATA[FinAIOps]]></category>
		<category><![CDATA[Token Economics]]></category>
		<guid isPermaLink="false">https://cloudar.be/?p=22794</guid>

					<description><![CDATA[<p>The token is the new gigabyte. Applying cloud cost discipline to AI workloads before the bill arrives.</p>
<p>The post <a href="https://cloudar.be/awsblog/finaiops-token-economics/">FinAIOps: Why Token Economics Will Define Your AI Operations</a> appeared first on <a href="https://cloudar.be">Cloudar</a>.</p>
]]></description>
										<content:encoded><![CDATA[<p>Somewhere out there, a developer is teaching Claude to talk like a caveman. This is a real thing. A <a href="https://github.com/juliusbrussee/caveman" target="_blank" rel="noopener noreferrer">viral Claude Code skill</a> strips the articles, pleasantries, and filler out of the model&#8217;s responses, so a sentence like &#8220;the reason your component keeps re-rendering is likely that you are creating a new object reference on each render cycle&#8221; collapses into &#8220;new object ref each render, re-render, wrap in useMemo.&#8221; The reported saving is up to 75 percent fewer output tokens, with the technical content fully intact. Brain still big, as the skill&#8217;s author puts it. Mouth small.</p>
<p>It is the most primitive cost optimization imaginable, and the fact that people reach for it tells you exactly where AI operations are heading. Developers are willing to make their assistant grunt like a Neanderthal to trim a few thousand tokens off a session. Something changed to make that feel worth doing.</p>
<p>For the past two years, most of us have been running AI workloads on someone else&#8217;s dime. Flat-rate subscription plans made generative AI feel free at the point of use. Fire off as many prompts as you want, let your coding agent churn through refactors overnight, and the bill stays the same.</p>
<p>That era is ending. LLM providers are increasingly pushing heavy workloads toward usage-based pricing, credits, stricter rate limits, or token-metered APIs, and the reason is simple: the plans were too cheap. The compute behind a heavy agentic workload costs real money, and providers can no longer subsidize power users with the margins of light users. Rate limits are tightening, &#8220;unlimited&#8221; tiers are disappearing, and token-based billing is becoming the norm.</p>
<p>If you have ever watched an AWS bill balloon because nobody rightsized their EC2 fleet, you know exactly what happens next. The token is the new gigabyte, and we are about to relive the FinOps learning curve, this time for AI.</p>
<p>That is why we need FinAIOps: FinOps for AI systems, where LLMOps meets cost discipline in production. It is the practice of running AI workloads with the same operational and cost rigor we apply to everything else in the cloud.</p>
<h2>Lessons from building agents in production</h2>
<p>At Cloudar we have been building and running agentic AI workloads in production. Doing that teaches you very quickly where tokens go to die. These are the practices that made the biggest difference.</p>
<h3>1. Use smaller models for simpler tasks</h3>
<p>Not every task needs your most capable model. Agent routing, classification, and simple extraction run perfectly well on smaller, cheaper models. Reserve the frontier model for the reasoning-heavy steps. The per-token price difference between a frontier model and a small model on Bedrock is easily an order of magnitude, so a lightweight router that dispatches work to the right specialist pays for itself immediately.</p>
<p>This is where Amazon Bedrock shines: switching between model families and sizes is a configuration change, not a re-architecture. You can experiment with the cost and quality trade-off per task and measure the result.</p>
<h3>2. Gatekeep the agent: deterministic first</h3>
<p>The cheapest LLM call is the one you never make. If a task can be solved deterministically, solve it deterministically. Fetching a metric, checking a threshold, parsing a known log format: none of that needs an agent. Put a gate in front of your agent that handles the predictable cases with plain code and only escalates genuine ambiguity to the model.</p>
<h3>3. Keep prompts compact</h3>
<p>Prompts are tokens, and tokens are money. Every instruction, every example, every &#8220;please be helpful and thorough&#8221; costs you on every single invocation. Ruthlessly edit your system prompts. Say what you need, cut what you do not, and test whether shorter prompts degrade quality. Usually they do not.</p>
<h3>4. Limit the tools your MCP servers expose</h3>
<p>This one is underestimated. Every tool definition you expose to an agent is injected into the context on every call. It might feel convenient to give your agent the full toolbox, but a wall of tool schemas eats tokens before the agent has done any actual work.</p>
<p>Only expose the tools the agent genuinely needs. And when you do not know upfront which tools an agent will use, for example with open-ended investigative workloads, take an iterative approach: expose everything, have the agent write a short analysis after each run, and after a set period feed those results to an advanced model to analyze which tools earn their place and which can be dropped. Treat your tool catalog like an IAM policy: least privilege, reviewed regularly.</p>
<h3>5. Cap the loop</h3>
<p>Agentic workloads can run away. An agent stuck in a retry loop is the token equivalent of a Lambda retry storm. Set a maximum number of steps and tool calls per run, and a hard token budget per invocation. Fail loud, not expensive.</p>
<h3>6. Mind your outputs and your history</h3>
<p>For many frontier models, output tokens are priced significantly higher than input tokens. Ask for structured output instead of prose, set max_tokens deliberately, and instruct the model to be terse. And do not drag the full conversation history through every turn: summarize or window older context, because in long-running agents the context snowballs and you pay for all of it on every call.</p>
<h3>7. Use prompt caching</h3>
<p>On Bedrock, prompt caching lets you cache the static parts of your context, such as system prompts and tool definitions, and pay a fraction of the input price on subsequent calls. If you have a large tool catalog you cannot trim further, caching softens the blow considerably. Combined with point 4, this is one of the highest-impact optimizations available today.</p>
<h3>8. Batch what is not urgent</h3>
<p>Amazon Bedrock batch inference runs asynchronous workloads at a 50 percent discount compared to on-demand pricing. You submit a JSONL file with your prompts, Bedrock processes them asynchronously, and the results land in S3, typically within 24 hours. Periodic analysis jobs are a textbook example: nobody is waiting on the result, so there is no reason to pay real-time prices for it.</p>
<p>Bedrock also offers a Flex service tier for supported models, trading latency for lower cost. Unlike batch, Flex uses the regular invocation API: you add a service tier parameter to your call and accept increased latency in exchange for the lower rate. Availability and discount levels depend on the model and tier, so check the current pricing page before assuming the same economics as batch. It is a good fit for background agent runs that are real-time in shape but not in urgency.</p>
<p>The practices above, at a glance:</p>
<table>
<thead>
<tr>
<th>Optimization</th>
<th>Saves</th>
<th>Risk</th>
</tr>
</thead>
<tbody>
<tr>
<td>Smaller model routing</td>
<td>High</td>
<td>Quality regression</td>
</tr>
<tr>
<td>Deterministic gate</td>
<td>Very high</td>
<td>Missed ambiguity</td>
</tr>
<tr>
<td>Prompt trimming</td>
<td>Medium</td>
<td>Lost instructions</td>
</tr>
<tr>
<td>Tool pruning</td>
<td>High</td>
<td>Agent can&#8217;t act</td>
</tr>
<tr>
<td>Loop caps</td>
<td>Very high</td>
<td>Incomplete runs</td>
</tr>
<tr>
<td>Prompt caching</td>
<td>High</td>
<td>Cache eligibility limits</td>
</tr>
<tr>
<td>Batch inference</td>
<td>High</td>
<td>Latency</td>
</tr>
</tbody>
</table>
<h2>Measure it or it did not happen</h2>
<p>Optimization without measurement is guesswork. Two AWS capabilities matter here.</p>
<p><strong>Amazon CloudWatch</strong> gives you deep visibility into every dimension of your Bedrock usage. Bedrock publishes runtime metrics to the <code class="" data-line="">AWS/Bedrock</code> namespace, with <code class="" data-line="">ModelId</code> among the available dimensions. Which dimensions apply, and whether <code class="" data-line="">ModelId</code> alone is enough, depends on the model, Region, service tier, and whether you invoke through an inference profile, so treat any dashboard as a starting point rather than a template that works unchanged everywhere. The ones to watch:</p>
<ul>
<li><code class="" data-line="">Invocations</code>: how often each model is called</li>
<li><code class="" data-line="">InputTokenCount</code> and <code class="" data-line="">OutputTokenCount</code>: where your money actually goes</li>
<li><code class="" data-line="">InvocationLatency</code>: the quality side of the trade-off</li>
<li><code class="" data-line="">InvocationThrottles</code> and <code class="" data-line="">InvocationClientErrors</code>: the signals that an agent is misbehaving</li>
</ul>
<p>Build a dashboard on these, and set an alarm on token consumption. For example, a CloudWatch alarm on the hourly <code class="" data-line="">Sum</code> of <code class="" data-line="">OutputTokenCount</code> per model catches a runaway agent loop within the hour instead of on next month&#8217;s invoice:</p>
<pre><code class="language-bash" data-line="">aws cloudwatch put-metric-alarm \
  --alarm-name bedrock-output-token-spike \
  --namespace AWS/Bedrock \
  --metric-name OutputTokenCount \
  --dimensions Name=ModelId,Value=&lt;your-bedrock-model-id-or-inference-profile&gt; \
  --statistic Sum --period 3600 \
  --threshold 5000000 \
  --comparison-operator GreaterThanThreshold \
  --evaluation-periods 1 \
  --alarm-actions arn:aws:sns:eu-west-1:123456789012:ops-alerts
</code></pre>
<p>Replace the model ID with the exact model or inference profile dimension used in your account, since Bedrock model IDs are versioned and vary by Region and provider. Enable model invocation logging as well, so you can see the actual prompts behind an anomaly. Treat anomalous spend like any other operational incident.</p>
<p><strong>Bedrock application inference profiles</strong> let you tag usage per agent, per workflow, or per customer. You create a profile that wraps a foundation model, attach cost allocation tags, and invoke through the profile ARN instead of the model ID:</p>
<pre><code class="language-bash" data-line="">aws bedrock create-inference-profile \
  --inference-profile-name customer-a-investigator \
  --model-source copyFrom=arn:aws:bedrock:eu-west-1::foundation-model/anthropic.claude-sonnet-4-5 \
  --tags key=customer,value=customer-a key=agent,value=investigator
</code></pre>
<p>Those tags flow through to Cost Explorer and CloudWatch, turning &#8220;the AI bill is high&#8221; into &#8220;agent X on task Y for customer Z is driving the cost.&#8221; For a managed service provider, this is essential: it enables proper chargeback and shows customers exactly what their AI workloads cost.</p>
<p>Finally, track the metric that actually matters: cost per outcome. Tokens per completed task beats tokens per month. An agent that uses three times the tokens but delivers twice the results is the cheaper agent. That is the KPI that makes FinAIOps a business discipline instead of a savings exercise.</p>
<h2>The bill is coming. Be ready.</h2>
<p>The shift from plans to tokens is not a pricing tweak, it is a forcing function. Teams that treat AI as free will get the same surprise bills we saw in the early cloud days. Teams that apply FinAIOps discipline, right-sized models, gated invocations, lean prompts, curated tool catalogs, caching, batching, and real cost attribution, will run AI workloads that are both powerful and predictable.</p>
<p>We learned the hard way with EC2 that capacity discipline pays off. Let us not learn it the hard way again with tokens.</p>
<p>The post <a href="https://cloudar.be/awsblog/finaiops-token-economics/">FinAIOps: Why Token Economics Will Define Your AI Operations</a> appeared first on <a href="https://cloudar.be">Cloudar</a>.</p>
]]></content:encoded>
					
		
		
			</item>
		<item>
		<title>When the model goes dark: keeping your AI agent available on Amazon Bedrock</title>
		<link>https://cloudar.be/awsblog/when-the-model-goes-dark-keeping-your-ai-agent-available-on-amazon-bedrock/</link>
		
		<dc:creator><![CDATA[Tom De Blende]]></dc:creator>
		<pubDate>Tue, 23 Jun 2026 14:34:02 +0000</pubDate>
				<category><![CDATA[AI]]></category>
		<category><![CDATA[AWS Blog]]></category>
		<guid isPermaLink="false">https://cloudar.be/?p=22747</guid>

					<description><![CDATA[<p>Keeping an LLM-powered agent available when a model is unavailable: configuring fallbacks, running your own models, and the Bedrock pitfalls that are not just a config switch.</p>
<p>The post <a href="https://cloudar.be/awsblog/when-the-model-goes-dark-keeping-your-ai-agent-available-on-amazon-bedrock/">When the model goes dark: keeping your AI agent available on Amazon Bedrock</a> appeared first on <a href="https://cloudar.be">Cloudar</a>.</p>
]]></description>
										<content:encoded><![CDATA[<p>In June 2026, Anthropic abruptly disabled access to its most capable models, Fable 5 and Mythos 5, for every customer, after a US export-control directive barred foreign nationals from using them. Not a throttle. Not a deprecation notice with a migration window. A frontier model that worked on Friday was simply gone, for reasons that had nothing to do with uptime.</p>
<p>That is the uncomfortable part of putting an LLM-powered agent into production: you inherit a dependency that never shows up on the architecture diagram. Someone else&#8217;s model has to stay reachable for your system to do anything at all. Usually the ways it fails are mundane. The model gets throttled the week you need it most, or deprecated on the vendor&#8217;s timeline rather than yours, or it simply has a bad afternoon while your incident volume spikes. June was the reminder that it can also be a regulator drawing a line. Either way, the day it happens, your &#8220;autonomous&#8221; system is exactly as autonomous as a 500 error.</p>
<p>We had been building an operations agent that investigates tickets and reasons over live infrastructure, and we had already decided not to hard-wire it to a single model. The June suspension is what turned that from a prudent hedge into an obvious one, and it is why we are writing this up now. The agent is genuinely useful, which is the problem: the more people rely on it, the less acceptable &#8220;the model is unavailable right now&#8221; becomes as an answer. This post is how we think about that availability problem, why we landed on Amazon Bedrock as the foundation, and (more importantly) the things we got wrong on the way, because the interesting lessons are in the pitfalls, not the happy path.</p>
<p><strong>Two ways to stop betting the business on one model</strong></p>
<p>There are really only two structural answers to &#8220;what happens when my model is gone&#8221;:</p>
<ul>
<li><strong>Configure fallbacks.</strong> Have more than one model the agent can run on, and fail over when the primary is unavailable.</li>
<li><strong>Run your own model.</strong> Remove the third-party API from the critical path entirely, so availability is something you control rather than something you subscribe to.</li>
</ul>
<p>Both are sound. Both are also more subtle than they sound, and the subtlety is the whole point of this article. Neither is &#8220;set a second model ID and you&#8217;re done.&#8221;</p>
<p>The reason we built on Amazon Bedrock is that it makes both strategies reachable from one place. Through a single AWS IAM surface, one set of credentials, one regional endpoint, and one billing path, Bedrock gives you access to a large catalogue of foundation models from multiple providers. Via Amazon Bedrock Custom Model Import you can bring your own open-weight models, and Amazon Bedrock Marketplace adds a catalogue of others to deploy. You can layer Amazon Bedrock Guardrails across all of them as a provider-independent safety control, and you keep your data inside your chosen AWS Region. For a European services partner like us, whose customers are specific about where their data is processed, Region control often settles the whole approach before model quality even enters the conversation.</p>
<p>So far, so much like a Bedrock landing page. Here is where it got real for us.</p>
<p><strong>Pitfall 1: &#8220;swap the model ID&#8221; is an access abstraction, not an application one</strong></p>
<p>The single most useful mental model we developed is this distinction. Bedrock abstracts <em>access and transport</em>: one credential, one API, one bill, to reach many models. It does <em>not</em> abstract the request and response shape your application actually depends on.</p>
<p>When you start, you almost certainly reach for a provider&#8217;s own SDK or the request format of whichever model you adopted first. That code grows roots. Your agent loop parses the specific content-block shape that model returns: the way tool calls are represented, the field names, the IDs. Your retry logic, your streaming handling, your token accounting all quietly assume one family&#8217;s conventions. The moment you point that code at a different model family, the transport works perfectly and the parsing falls apart, because you didn&#8217;t insert a model-agnostic layer. You inserted one-vendor-on-Bedrock, which borrows Bedrock&#8217;s plumbing but speaks only one dialect.</p>
<p>Amazon Bedrock does offer a genuinely cross-model interface, the Converse API, which normalises messages and tool configuration into a common shape across many models. Most current foundation models on Bedrock are reachable through it, so adopting Converse from day one avoids a lot of this pain. The catch is at the edges: you trade away some of the richer, provider-specific surface, and a few models still expose their newest capabilities only through their own API shapes. A fully general agent can therefore end up maintaining more than one transport path anyway, which is exactly the situation the next point is about.</p>
<p>The lesson that generalises: <strong>build a thin internal seam early.</strong> Define one interface that your agent talks to, pick one canonical shape for messages and tool calls, and put each model family behind an adapter that translates its wire format to and from that shape. Concretely, the boundary is about this small:</p>
<pre class="wp-block-code"><code class="" data-line=""># one interface the agent depends on; one adapter per model family behind it
class ModelClient(Protocol):
    async def respond(self, messages: list[Block], tools: list[Tool]) -&gt; list[Block]: ...

# AnthropicClient, ConverseClient, ... each satisfy this and own the
# translation between their provider&#039;s wire format and the canonical Block.
def make_client(model_id: str) -&gt; ModelClient: ...  # fail-closed: unknown id raises</code></pre>
<p>Your dispatch loop only ever sees the canonical block, never a vendor payload. Make the factory <em>fail-closed</em>: an unrecognised model ID should raise, never silently route to a &#8220;best guess.&#8221; Fallback is only safe if the fallback path is one you&#8217;ve explicitly built and tested, not one your code stumbles into.</p>
<p>This is also why a framework like LangChain or LiteLLM is not a shortcut past the problem. It hands you a ready-made version of that seam across providers, which is genuinely useful, but it abstracts the wire format, not the behaviour. The per-model prompt sensitivity, the tool-calling quirks, the caching mechanics: those leak straight through any unified interface, yours or off-the-shelf.</p>
<p><strong>Pitfall 2: models are not drop-in equivalents, even at equal &#8220;quality&#8221;</strong></p>
<p>The second hard lesson is that two models can both be excellent and still not be interchangeable in your harness.</p>
<p>Concrete example: provider-specific prompt caching. The cost and latency model of an agent that re-sends a large tool-and-context preamble every turn depends heavily on prompt caching, and the way you mark cacheable spans (and even how many cache breakpoints you are allowed) is vendor-specific. Switch families and your carefully tuned caching strategy simply does not apply; your costs and latency move, sometimes sharply.</p>
<p>Another: model-version quirks. We found a specific model version would occasionally malform its tool calls in a way we had to detect and repair in the dispatch loop. That repair is correct for that version and meaningless for every other model. Tool-calling reliability, instruction-following under pressure, willingness to say &#8220;I don&#8217;t know&#8221; instead of fabricating: these vary enormously between models and are exactly the behaviours an agent lives or dies by.</p>
<p>So &#8220;best way to use a model&#8221; is real, and it is per-model: the prompt that gets the best out of one model is not the prompt that gets the best out of another, and the safety posture that one model respects, another ignores. A fallback model isn&#8217;t a spare tyre of the same size; it&#8217;s a different vehicle that happens to drive on the same roads. Treat the migration to it as a real piece of engineering, scoped and tested ahead of time, so that on the day you actually need it you are flipping a switch you have already proven.</p>
<p><strong>Pitfall 3: a fallback ladder is also a cost ladder</strong></p>
<p>The third consideration bites only after you have shipped: the model you fail over to has a different price, and the Region you are obliged to run it in has a different price again. On Bedrock these are two separate effects worth keeping straight. Token pricing varies widely by family, often by an order of magnitude between a frontier model and a lighter open-weight one, which is visible on the public Bedrock pricing page. Separately, Cross-Region inference itself does not add a surcharge: a request is billed at the inference profile&#8217;s published rate, which for current AWS profiles matches the on-demand rate of that profile&#8217;s primary Region. What moves the number is which profile you are obliged to use. The EU inference profile that keeps data in-region can sit above the cheapest on-demand Region for the same model. In our own cost modelling we carry roughly a 10% uplift on the EU inference-profile routes for our primary family against the equivalent US on-demand rate, and we treat that as the standing price of residency.</p>
<p>So a fallback ladder is also a cost ladder, and the two do not move together. Failing over to a cheaper open-weight model can save money while costing you quality; failing over to a residency-compliant route can cost more for the same model. Work both deltas out in advance, so a failover event doesn&#8217;t arrive as a billing surprise stacked on top of an incident.</p>
<p><strong>Where Bedrock genuinely shines: cheap, isolated, side-by-side evaluation</strong></p>
<p>Here is the flip side of all that subtlety: because every model lives behind the same Bedrock access surface, comparing them becomes an infrastructure problem you already know how to solve, not a procurement project per vendor.</p>
<p>We stood up a second, isolated runtime (same agent code, separate deployment, separate logs, separate metrics namespace) whose only job is to run candidate models against hard, representative tasks without touching production. A few design choices made this evaluation trustworthy, and they generalise well:</p>
<ul>
<li><strong>Isolate it at the infrastructure level, not by convention.</strong> A separate runtime, image tag, log group and metrics namespace mean eval traffic can never pollute production dashboards or alerts, and a candidate model can never accidentally take a real action. Make the isolation fail-closed: if the eval deployment is missing its explicit configuration, it should refuse to deploy rather than fall back to production settings.</li>
<li><strong>Grade blind.</strong> If the evaluation environment can read the &#8220;right answer&#8221; (a human&#8217;s resolution notes, a linked root-cause record), a weaker model can look strong by quietly reading the answer key. Strip those inputs so you are measuring reasoning, not retrieval of the solution.</li>
<li><strong>Run a harness-fit probe before you blame the model.</strong> When a candidate underperforms, the natural reaction is &#8220;our prompt isn&#8217;t tuned for it.&#8221; So test that hypothesis directly: harden the prompt specifically for the candidate and re-measure. Our most valuable single finding came from this: the gap between our primary model and the alternatives was mostly model-intrinsic, not a prompt artefact. That told us the seam was worth keeping for break-glass resilience, but that switching the default wasn&#8217;t justified yet. You only learn that by measuring.</li>
</ul>
<p>A safety note that bears repeating, because it surprised us: a &#8220;dry-run&#8221; flag that suppresses one kind of side effect doesn&#8217;t suppress all of them. In our case, suppressing the agent&#8217;s writes did not suppress its reads against live infrastructure. If a candidate model can call tools, those calls execute for real during evaluation. The durable backstop is least-privilege, read-only credentials at the boundary, not a flag in your application code. Defence in depth applies to your evaluation environment too.</p>
<p><strong>Running your own model: removing the API from the critical path</strong></p>
<p>Configuring fallbacks hedges against one model being unavailable. Running your own hedges against a different risk: not wanting your core workflow to depend on a third-party inference API at all, whether for sovereignty, predictable capacity, or a model fine-tuned on your own domain. The point of doing it on Bedrock is that the operational surface barely changes when the weights become yours: the same IAM controls and the same API, with Guardrails layered on where the model architecture supports them. Amazon Bedrock Custom Model Import brings supported open-weight architectures behind that surface; Amazon Bedrock Marketplace widens the catalogue; and Provisioned Throughput reserves dedicated capacity for steady, latency-sensitive load. Because the surface stays the same, a single seam can mix managed and self-hosted models on the same ladder.</p>
<p>The honest caveats are real but different from classic self-hosting. With Custom Model Import the serving and autoscaling stay AWS-managed (billed by Custom Model Units, with cold-start latency on an idle model), so what you take on is the cost model, the supported-architecture limits, and a quality bar an open-weight model may not clear for your task, not server ops. You only own capacity planning and scaling if you go all the way to your own Amazon SageMaker or EC2 endpoints, outside Bedrock. For most teams the right posture is a hybrid:</p>
<ul>
<li><strong>Primary: a strong managed model.</strong> Your default. The one you have evaluated hardest and trust unattended.</li>
<li><strong>Fallback: a tested alternative, break-glass.</strong> Already proven through the seam on a normal day, not discovered during an outage.</li>
<li><strong>Self-hosted: for workloads where control wins.</strong> Reserved for cases where sovereignty or capacity genuinely outweighs the operational cost.</li>
</ul>
<p><strong>What we&#8217;d tell our past selves</strong></p>
<ul>
<li><strong>Build the seam before you need it.</strong> One internal interface, one adapter per model family, fail-closed routing. Retrofitting this under outage pressure is miserable.</li>
<li><strong>Treat &#8220;switch to the fallback&#8221; as engineering, not configuration.</strong> Prompts, caching, tool-calling quirks, and safety posture are all per-model. Prove the fallback works on a normal day.</li>
<li><strong>Default to your best model; keep the alternative warm.</strong> The point of the seam often isn&#8217;t to leave your strongest model; it&#8217;s resilience and the option to re-evaluate as the field moves.</li>
<li><strong>Make evaluation a first-class, isolated environment.</strong> Blind grading and a harness-fit probe will tell you whether your problem is the model or your prompt, saving you from both over-engineering and false economy.</li>
<li><strong>Put the real safety control at the boundary.</strong> Read-only, least-privilege credentials and Guardrails protect you regardless of which model is behind the seam, including during evaluation.</li>
</ul>
<p>Those five are tactics. The shift underneath them is the real payoff. Amazon Bedrock did not make the model-specific subtlety disappear, and nothing will. What it changed is where the subtlety lives: behind one access surface, one security model, and one bill that we own, instead of scattered across vendor relationships we could only hope held. &#8220;Keep the agent running when a model goes dark&#8221; stopped being a procurement question and became an architecture decision.</p>
<p><em>Written at Cloudar, an AWS Premier Tier Services Partner. The lessons here come from production experience building AI-assisted operations tooling on AWS.</em></p>
<p>The post <a href="https://cloudar.be/awsblog/when-the-model-goes-dark-keeping-your-ai-agent-available-on-amazon-bedrock/">When the model goes dark: keeping your AI agent available on Amazon Bedrock</a> appeared first on <a href="https://cloudar.be">Cloudar</a>.</p>
]]></content:encoded>
					
		
		
			</item>
		<item>
		<title>Cloudar at AWS re:Invent 2024 – Your Guide to an Unforgettable Experience</title>
		<link>https://cloudar.be/awsblog/cloudar-at-aws-reinvent-2024-your-guide-to-an-unforgettable-experience/</link>
		
		<dc:creator><![CDATA[Daan Theunis]]></dc:creator>
		<pubDate>Thu, 17 Oct 2024 11:39:26 +0000</pubDate>
				<category><![CDATA[AI]]></category>
		<category><![CDATA[AWS Blog]]></category>
		<category><![CDATA[AWS re:Invent]]></category>
		<guid isPermaLink="false">https://cloudar.be/?p=22332</guid>

					<description><![CDATA[<p>Cloudar at AWS re:Invent 2024 – Your Guide to an Unforgettable Experience &#160; We’re thrilled to announce that Cloudar will be attending AWS re:Invent 2024 in Las Vegas! As the biggest annual gathering for cloud enthusiasts, experts, and innovators, AWS re:Invent offers countless opportunities to learn, connect, and discover what’s new in the world of [&#8230;]</p>
<p>The post <a href="https://cloudar.be/awsblog/cloudar-at-aws-reinvent-2024-your-guide-to-an-unforgettable-experience/">Cloudar at AWS re:Invent 2024 – Your Guide to an Unforgettable Experience</a> appeared first on <a href="https://cloudar.be">Cloudar</a>.</p>
]]></description>
										<content:encoded><![CDATA[<h2>Cloudar at AWS re:Invent 2024 – Your Guide to an Unforgettable Experience</h2>
<p>&nbsp;</p>
<p>We’re thrilled to announce that Cloudar will be attending AWS re:Invent 2024 in Las Vegas! As the biggest annual gathering for cloud enthusiasts, experts, and innovators, AWS re:Invent offers countless opportunities to learn, connect, and discover what’s new in the world of cloud technology. But with so much happening—from keynotes to hands-on labs, networking sessions to deep-dive discussions—it can sometimes feel overwhelming to navigate everything this event has to offer.</p>
<p>That’s why we initially developed our <strong>re:</strong><strong>Invent Chatbot</strong>, a friendly assistant designed to make your re:Invent experience smoother and more enjoyable! While we’re excited to share the concept, due to AWS guidelines, the chatbot will not be available for use at this year’s event. However, the development of this tool still serves as a great example of how cloud-driven AI can transform the event experience.</p>
<p>&nbsp;</p>
<h3><strong>Meet the re:Invent Chatbot – A Vision for Personalized Event Assistance</strong></h3>
<p>Even though the chatbot is offline for now, it’s an exciting demonstration of how technology can make large-scale events like AWS re:Invent easier to navigate. Whether you&#8217;re searching for the perfect session, need quick answers to FAQs, or just want help organizing your schedule, the chatbot was designed with the user in mind.</p>
<p>Here’s what the re:Invent Chatbot <strong>would</strong> have been able to do:</p>
<ul>
<li><strong>Session Navigation</strong>: With hundreds of sessions happening at once, it’s easy to lose track. Our chatbot could help you quickly find sessions that match your interests or needs—just ask for recommendations, and you’d be pointed in the right direction.</li>
<li><strong>Answer FAQs</strong>: From event logistics to session details, the chatbot was equipped with a wealth of knowledge to answer questions on the fly.</li>
</ul>
<p>&nbsp;</p>
<p><strong><img fetchpriority="high" decoding="async" class="wp-image-22333 alignnone" src="https://cloudar.be/wp-content/uploads/2024/09/Chatbot.png" alt="" width="1171" height="597" srcset="https://cloudar.be/wp-content/uploads/2024/09/Chatbot.png 1663w, https://cloudar.be/wp-content/uploads/2024/09/Chatbot-768x392.png 768w, https://cloudar.be/wp-content/uploads/2024/09/Chatbot-1536x783.png 1536w, https://cloudar.be/wp-content/uploads/2024/09/Chatbot-1280x653.png 1280w" sizes="(max-width: 1171px) 100vw, 1171px" /></strong></p>
<h3></h3>
<p>&nbsp;</p>
<h3>Taking it Further: Imagine a Chatbot for Music Festivals</h3>
<p>Let’s take the concept one step further. Imagine attending a large music festival with dozens of stages and hundreds of performers over a few days. It can be daunting to decide who to see and when. That’s where a <strong>Music Festival Chatbot</strong> could come in handy.</p>
<p>For example, you could tell the chatbot your favorite genres—let’s say you’re into electronic music, indie rock, and a bit of jazz on the side. The chatbot could take that input and instantly suggest a personalized lineup for you, complete with the times and locations of each performance. It could also help you with last-minute schedule changes or even recommend food trucks or merch stands nearby during set breaks.</p>
<p>Here&#8217;s what this <strong>Music Festival Chatbot</strong> could do:</p>
<ul>
<li><strong>Personalized Lineup Recommendations</strong>: Based on your music preferences, the chatbot could suggest artists, DJs, or bands you might enjoy, even introducing you to new acts within your favorite genres.</li>
<li><strong>Time Schedule:</strong> Once your lineup is set, the chatbot could create a custom schedule for you which you could use throughout the event.</li>
</ul>
<p>Just like our re:Invent Chatbot concept, this Music Festival Chatbot shows the potential of AI to personalize experiences, turning chaotic, multi-day events into seamless, curated adventures.</p>
<p>&nbsp;</p>
<h3>Why Build a Chatbot?</h3>
<p>At Cloudar, we believe that technology should make life simpler, not more complicated. The re:Invent Chatbot embodies that philosophy. By leveraging cloud-based AI, we aimed to enhance attendees’ experiences, reducing the stress of juggling schedules or missing key moments.</p>
<p>Though the tool won&#8217;t be live this year, we hope it sparks inspiration for the many possibilities that cloud technologies can offer in the future. And, of course, we’ll be keeping this idea in our toolkit for future events.</p>
<p>&nbsp;</p>
<h3>Let’s Connect in Las Vegas!</h3>
<p>We can’t wait to see you at AWS re:Invent 2024! If you’re attending, don’t hesitate to reach out—we’d love to grab a cold beer together and chat about all things cloud. Whether you want to talk about AWS, share your re:Invent experience, or discuss how tools like the re:Invent Chatbot could evolve, we’re always eager to connect.</p>
<p>The post <a href="https://cloudar.be/awsblog/cloudar-at-aws-reinvent-2024-your-guide-to-an-unforgettable-experience/">Cloudar at AWS re:Invent 2024 – Your Guide to an Unforgettable Experience</a> appeared first on <a href="https://cloudar.be">Cloudar</a>.</p>
]]></content:encoded>
					
		
		
			</item>
		<item>
		<title>Meet our Pinbot Powered by Claude</title>
		<link>https://cloudar.be/awsblog/meet-our-pinbot-powered-by-claude/</link>
		
		<dc:creator><![CDATA[Team Cloudar]]></dc:creator>
		<pubDate>Mon, 10 Jun 2024 08:35:07 +0000</pubDate>
				<category><![CDATA[AI]]></category>
		<category><![CDATA[AWS Blog]]></category>
		<guid isPermaLink="false">https://cloudar.be/?p=22101</guid>

					<description><![CDATA[<p>Get to know our #AWSome Pinball Break Room At Cloudar, our break room isn’t just for coffee breaks – it’s the battleground for the legendary ‘Pinball Grand Champion Cup.’  &#8211; a prestigious, though temporary, ownership. Every few months, we swap out the pinball machine, igniting a fresh round of competition. This means that every three [&#8230;]</p>
<p>The post <a href="https://cloudar.be/awsblog/meet-our-pinbot-powered-by-claude/">Meet our Pinbot Powered by Claude</a> appeared first on <a href="https://cloudar.be">Cloudar</a>.</p>
]]></description>
										<content:encoded><![CDATA[<h3><span lang="EN">Get to know our #AWSome Pinball Break Room</span></h3>
<p>At Cloudar, our break room isn’t just for coffee breaks – it’s the battleground for the legendary ‘Pinball Grand Champion Cup.’  &#8211; a prestigious, though temporary, ownership. Every few months, we swap out the pinball machine, igniting a fresh round of competition. This means that every three to six months, we must ‘relearn’ a new game, which, while fun, can be a distraction from our actual (#AWSome) work. Some of us embrace the challenge as a delightful learning experience, while others simply want to know how to do multi-balls &amp; gain extra bonusses.</p>
<h3>Enter Claude Chatbot (aka Pinbot)</h3>
<p>But, learning each new game can be a bit of a time sink, right? That’s where our latest creation, <a href="https://cloudar.be/awsblog/claude-chatbot-on-aws/">the Claude Chatbot on AWS</a>, comes into play. It is a chatbot with RAG (Retrieval-Augmented Generation) capabilities. This means Claude can be loaded up with a wealth of knowledge from various sources like PDFs, YouTube videos, spreadsheets, even webpages.</p>
<p>Instead of loading Claude with legal texts or company manuals, I thought, &#8220;Why not make him a pinball wizard?&#8221; So, I programmed Claude to become the ultimate guide for our Teenage Mutant Ninja Turtle pinball machine. I fed it YouTube videos of expert players, detailed rule sheets, and tips on mastering the game. In just a few minutes, TMNT Pinbot was ready to roll.</p>
<h3><span lang="EN"><img decoding="async" class="alignnone size-medium wp-image-22103" src="https://cloudar.be/wp-content/uploads/2024/06/Picture1-571x433.png" alt="" width="571" height="433" /><img decoding="async" class="alignnone wp-image-22109" src="https://cloudar.be/wp-content/uploads/2024/06/Screenshot-2024-06-10-094606-650x433.png" alt="" width="572" height="381" srcset="https://cloudar.be/wp-content/uploads/2024/06/Screenshot-2024-06-10-094606-650x433.png 650w, https://cloudar.be/wp-content/uploads/2024/06/Screenshot-2024-06-10-094606-325x217.png 325w" sizes="(max-width: 572px) 100vw, 572px" /></span></h3>
<h3><span lang="EN">Playing Like a Pro</span></h3>
<p>Imagine standing in front of the pinball machine, unsure of your next move. You simply ask TMNT Pinbot, &#8220;How do I play as Michelangelo?&#8221; and within seconds, it gives you the exact shots you need to make. No more endless YouTube searches – instant answers and higher scores. This saves time, and increases revenue (or in this case; your score on a pinball game). Plus, the Pinbot can reference its sources, so you can see exactly where the tips are coming from.</p>
<h3><span lang="EN">Beyond Pinball: Claude&#8217;s Endless Possibilities</span></h3>
<p>Sure, the Pinbot is a fun &amp; quick gimmick, but Claude Chatbot&#8217;s potential goes far beyond gaming. Picture a world where your company’s entire knowledge base is just a question away. Need to check a guideline? Ask Claude. Trying to find a procedure buried in a mountain of documents? Claude’s got it. This isn’t just about saving time – it’s about enhancing productivity and ensuring consistency across the board; no more risky &#8220;creative&#8221; interpretations of your procedures/documentation.</p>
<h3><span lang="EN">Real-World Applications</span></h3>
<p>Imagine a repair bot for mechanics. Instead of combing through bulletins for error code 678, a mechanic could just ask the bot and get immediate, accurate suggestions. Or think about a compliance bot that ensures all your creative marketing ideas meet company policies. No more guessing if your booth design follows the AWS logo rules – just ask the bot, and it’ll tell you.</p>
<h3><span lang="EN">The Future is Conversational</span></h3>
<p>The Pinbot is just a fun demo, but it shows how powerful conversational interfaces can be. As we continue to refine our Claude Chatbot&#8217;s capabilities, we’re excited to see how this technology will revolutionize workplaces; From saving time to ensuring compliance. The future of work is conversational, and Cloudar is leading the charge.</p>
<p>Stay tuned for more use cases!</p>
<p>&nbsp;</p>
<p>The post <a href="https://cloudar.be/awsblog/meet-our-pinbot-powered-by-claude/">Meet our Pinbot Powered by Claude</a> appeared first on <a href="https://cloudar.be">Cloudar</a>.</p>
]]></content:encoded>
					
		
		
			</item>
	</channel>
</rss>
