/ Blog
Home Blog Contact Buddy Ads Builder Audit Engine

For those using portfolio bid strategy, how do you A/B test ...

Bidding & Smart Bidding

Google's Campaign Experiments don't support portfolio bid strategies, so you need to build your own test framework. The three reliable methods are: time-based sequential testing (run Strategy A for 4–6 weeks, then Strategy B for the same period), geo-based split testing (assign matched markets to each strategy simultaneously), and campaign cluster comparison (split thematically similar campaign groups). Always exclude the learning window — 7–21 days depending on volume — before measuring results.

Key takeaways

  • Campaign Experiments are incompatible with portfolio bid strategies by design — the pooled, cross-campaign nature of portfolio strategies conflicts with how the experiment tool splits traffic. [1]
  • Time-based sequential testing is the most practical method for most accounts, but it requires at least 50 conversions per week and comparable seasonal windows to produce a reliable signal.
  • Geo-based split testing offers the highest confidence because both strategies run simultaneously, eliminating time-based confounders — but it demands clean geographic segmentation and sufficient per-market volume.
  • The learning window (7–21 days depending on conversion volume) must be excluded from your measurement period; counting transition data against a new strategy is one of the most expensive mistakes in portfolio strategy testing.
  • Define your success criteria — specific metric, threshold, and timeframe — in writing before the test starts to prevent post-hoc rationalization from skewing conclusions.
Key terms
Portfolio Bid Strategy
A bid strategy in Google Ads that pools conversion data and applies a shared bidding objective — such as Target CPA or Target ROAS — across multiple campaigns simultaneously.
Learning Period
The window after a smart bidding strategy change during which the algorithm is calibrating to its new objective; performance during this period is unreliable and should be excluded from test analysis.
Sequential Testing
A testing method where you run one strategy for a defined period, switch to a second strategy for an equal period, and compare results across the two windows.
Geo Split Testing
A testing method that assigns matched geographic markets to different bid strategies running simultaneously, controlling for time-based confounders.
Impression Share Lost to Rank
The percentage of auctions where your ads didn't show because your Ad Rank was too low, used as a signal for whether a bid strategy is leaving efficiency on the table.

Why can't you use Campaign Experiments with portfolio bid strategies?

Campaign Experiments work by routing a percentage of auctions in real time to a treatment arm within a single campaign. [1] Portfolio bid strategies operate across multiple campaigns simultaneously — the algorithm pools conversion signals and makes cross-campaign pacing decisions as a unified system. [2] Splitting that logic mid-flight creates model conflicts Google hasn't built a solution for, and no setting change works around it.

The same property that makes portfolio strategies valuable — pooled signals, shared learning across campaigns — is precisely what makes them untestable with standard tooling. This came up in a recent r/googleads discussion, and the consensus is correct: you need to design your test methodology around this constraint from the start, not try to force the native experiment tool to do something it wasn't built for. For more context on how smart bidding logic works at the portfolio level, see the full bidding & smart bidding answer library.

Key Insight: The inability to use Campaign Experiments with portfolio bid strategies isn't a gap you can patch with a workaround. It's an architectural constraint. Build your testing framework around it.

What are the three methods for testing portfolio bid strategies?

The right method depends on your account structure, conversion volume, and tolerance for confounding variables. The table below summarizes the tradeoffs before we go deeper into each.

Method Isolation Quality Setup Complexity Min. Weekly Conversions Best For
Sequential (Time-Based) Low–Medium Low 50+ Most accounts; directional confidence
Geo Split High High 100+ per geo group National/regional accounts with clean geo data
Campaign Cluster Medium Medium 75+ per cluster E-commerce with distinct product categories

How do you run a time-based sequential test for portfolio bid strategies?

Sequential testing is the most accessible starting point: run Bid Strategy A for a defined period, switch to Bid Strategy B for an equal period, and compare performance across the two windows. The main risk is time-based confounders — seasonality and external market shifts — so controlling your calendar is critical.

How to structure a sequential test

  1. Establish a baseline period. Run your current strategy for at least 4 weeks, preferably 6. Pull weekly averages for CPA, ROAS, conversion rate, impression share, and average CPC.
  2. Document external variables. Log any promotions, landing page changes, budget changes, or competitor activity before the test begins. This change log is what separates a defensible conclusion from a guess.
  3. Set a transition window. After switching strategies, allow 1–2 weeks for the learning period before you start measuring. Do not count learning-phase data in your analysis.
  4. Run the test period. Match the duration of your baseline — typically 4–6 weeks of clean data after the learning window clears.
  5. Normalize for seasonal drift. Use GA4 data to apply rough adjustments if the two windows land in different demand periods. [3]
Common Mistake: Running a sequential test across a seasonality boundary — for example, switching strategies in mid-November — and attributing the performance difference to the bid strategy when Q4 demand is the real driver. Always align test windows to comparable seasonal periods.

Minimum volume requirements for sequential testing

If your account generates <30 conversions per week, sequential testing produces directional signals at best. Don't make structural bid strategy decisions on low-volume sequential results. If you're uncertain whether your account has the volume to support a valid test, the 250-point Google Ads audit engine can benchmark your account health before you commit to a methodology.

How do you run a geo-based split test for portfolio bid strategies?

Geo-based splits provide the highest confidence of any method because both strategies run simultaneously, which controls for time-based external factors automatically. The tradeoff is setup complexity and the requirement for meaningful conversion volume in each geographic group.

Building a geo split test

  1. Pull 90 days of geo performance. Break out data by state, DMA, or city depending on your scale. You need enough per-market conversion volume to give each portfolio strategy a real signal.
  2. Create matched pairs. Use historical CPA, conversion volume, and average order value to pair similar markets. Group A and Group B should look as close to identical as possible on a trailing 90-day basis.
  3. Duplicate campaign structure. Create two sets of geographically targeted campaigns and assign each to its own portfolio bid strategy.
  4. Use exclusions, not bid adjustments. Apply geographic exclusions rather than bid adjustments to keep audiences clean. Bid adjustments interact with the portfolio strategy's own logic and create confounding variables.
  5. Run for a minimum of 4 weeks simultaneously.
Best Practice: When building matched geo pairs, weight your matching toward conversion volume rather than revenue or ROAS. High-CPA outlier markets can skew ROAS comparisons dramatically. Pair on CPA and volume first, then sanity-check on revenue mix.

Geo splits work best for accounts with national or regional coverage. If your business is concentrated in a single metro area, you won't have enough geographic variance to split meaningfully. Also note that portfolio strategies with limited conversion data per geo group will struggle to optimize — you're giving the algorithm a smaller signal pool than it's designed to work with.

How do you test portfolio bid strategies using campaign clusters?

When geo segmentation isn't available, campaign cluster comparison lets you test across product lines, audience segments, or campaign themes — any dimension where you have natural groups of comparable campaigns. Assign one portfolio strategy to a set of thematically similar campaigns (for example, brand campaigns or top-product campaigns) and a different strategy to a comparable set.

The critical requirement is that clusters must have comparable historical performance profiles. If one cluster has a structurally lower CPA than the other due to keyword intent or audience differences, the test is contaminated before it starts. This approach is particularly well-suited to e-commerce accounts with distinct product categories. If you're evaluating which bid strategy combinations work well together structurally, see the recommended bidding strategy combo guide for practical combinations that practitioners use.

Key Insight: No matter which method you use, your test is only as valid as your baseline normalization. If week-over-week CPA swings >20% organically before you start, stabilize the account first. A volatile baseline produces meaningless test results regardless of method.

What metrics should you measure — and what should you ignore?

Measure at the portfolio level, not the campaign or ad group level, because that's the level at which the algorithm is optimizing. [2]

Primary metrics

Secondary metrics (directional only)

Metrics to deprioritize

Best Practice: Build your weekly reporting template before the test starts, not during or after. Decide in writing what a "win" looks like — for example, "Strategy B wins if CPA improves by >8% with no more than a 10% drop in conversion volume, measured over a 4-week clean window." Defining success criteria after you see the data is how confirmation bias enters the analysis.

How long does the portfolio strategy learning period last — and how do you handle it?

Smart bidding algorithms have learning periods that can last 1–3 weeks depending on conversion volume and the magnitude of the strategy change. [2] During this period, the algorithm is calibrating to the new objective — CPAs will often be worse, impression share may fluctuate, and spend pacing can behave erratically. If you start measuring on Day 1 of a strategy switch, you are measuring the transition, not the strategy.

Learning period exclusion guidelines by volume

Practically, check the bid strategy status report under Tools & Settings > Bid Strategies daily during your transition week. Don't start the measurement clock until you see "Eligible" status consistently for at least 3 consecutive days.

Common Mistake: Panicking during the learning window and switching back to the original strategy before the algorithm stabilizes. This resets the learning clock, wastes data you've already generated, and leaves you with no valid results. Commit to the transition window you defined before the test started — unless you're seeing a >50% CPA spike sustained for more than 5 days.

Using portfolio reporting as a sanity check

Under Tools & Settings > Bid Strategies, Google provides a portfolio-level report that shows bid strategy status history, target vs. actual CPA/ROAS over time, and impression share trends. This won't replace a controlled test, but it confirms when the learning period started and ended and whether the algorithm consistently met its targets during your measurement window. Cross-reference this against your test windows as a final sanity check before writing up results. This kind of structured review is also part of what Buddy, the AI Google Ads agent, surfaces when auditing portfolio bid strategy configurations.

What to do next

  1. Audit your conversion volume first. Pull weekly conversion totals for the campaigns you plan to test. If you're under 50 conversions per week in the portfolio, invest in conversion volume growth before running a bidding test — results won't be reliable enough to act on.
  2. Choose your method based on account structure. Geographic segmentation available and >100 conversions per week per geo group? Use the geo split method. Single market or limited segmentation? Use sequential or cluster testing based on your seasonal risk tolerance.
  3. Define success criteria in writing before you start. Specific metric, specific threshold, specific timeframe. Send it to a stakeholder to create external accountability — this one step eliminates most post-hoc rationalization.
  4. Build in a mandatory learning window exclusion. Set a calendar reminder for Day 7 (or Day 14 for lower-volume accounts) to check bid strategy status before you begin recording results. Never count learning-phase data in your analysis.
  5. Maintain a change log throughout. Any landing page change, promotion, budget change, or external market event during the test window must be logged with the date. This log is what makes your conclusion defensible when it's challenged later.

Frequently asked questions

Can you use Drafts & Experiments at all when portfolio bid strategies are involved?

No. Google's Campaign Experiments (formerly Drafts & Experiments) require the ability to split traffic at the campaign level in real time. Portfolio bid strategies make cross-campaign decisions simultaneously, which is architecturally incompatible with how the experiment tool works. There is no workaround — you need an external test framework like sequential or geo-split testing.

What's the minimum conversion volume needed to get a statistically meaningful result?

In practice, accounts need at least 50 conversions per week in the portfolio being tested to get a directional signal from sequential testing, and 100+ per week for results you'd act on with confidence. For geo split testing, that threshold applies per geographic group. Below 30 conversions per week, any test result is likely noise.

Should you test Target CPA against Target ROAS, or only compare two versions of the same strategy type?

You can test across strategy types — for example, Maximize conversions with a Target CPA against Maximize conversion value with a Target ROAS — but interpreting cross-type results is harder because the strategies optimize toward different objectives. If you're testing across types, use conversion value per conversion as your common denominator metric rather than CPA or ROAS in isolation.

How do shared budgets interact with portfolio bid strategy tests?

Shared budgets can contaminate portfolio bid strategy tests because the budget-pacing logic interacts with the bidding algorithm in unpredictable ways. For the duration of a test, assign dedicated individual budgets to each campaign group being tested rather than pooling through a shared budget. This isolates the bid strategy variable as cleanly as possible.

How do you handle accounts where seasonality makes sequential testing unreliable year-round?

For highly seasonal accounts, the geo split method is almost always the right choice because both strategies run simultaneously and seasonality affects both groups equally. If geo segmentation isn't available, narrow your sequential test windows to the flattest part of your demand calendar — typically mid-January through February or late September for most retail verticals — where week-over-week variance is lowest.

What's the difference between a portfolio bid strategy floor/ceiling and a campaign-level bid limit?

Portfolio bid strategies let you set minimum and maximum CPC limits that apply across all campaigns in the portfolio, giving the algorithm guardrails without restricting it to a single campaign's constraints. Campaign-level bid limits apply only to that campaign. The portfolio-level controls are generally preferable because they let the algorithm allocate across campaigns more freely while still staying within your risk tolerance.

References

  1. Google Ads Help. “Set up a custom experiment.” Accessed Nov 7, 2026.
  2. Google Ads Help. “About Smart Bidding.” Accessed Nov 7, 2026.
  3. Google Analytics Help. “Introducing the next generation of Google Analytics.” Accessed Nov 7, 2026.
  4. Wikipedia. “Cost per action.” Accessed Nov 7, 2026.
  5. Google Ads Help. “About Ad Rank.” Accessed Nov 7, 2026.
  6. Original community discussion: r/googleads thread on Reddit.

Related Reading

AI Disclosure: This article was generated with AI assistance based on a community discussion on Reddit r/googleads. Expert analysis and practitioner perspective by John Williams, Founder, AHMEEGO · Google Ads Practitioner with $350M+ in managed Google Ads spend. AI was used to draft and structure the content; all strategic recommendations reflect real campaign experience.