Filtering a matrix in Power BI but not the rows

Question

I want to filter a matrix of data in Power BI by total for one category but leave the row context unfiltered to allow drill down.

I am using a switch measure but it evaluates down to the row level too and I'm not sure how to adjust it. Can someone provide a suggestion?

This image shows filter of >100000 but the filter is applied to rows too

1. Swtich = SWITCH(SELECTEDVALUE('Sales Control Table'[ID]), 1,[Over25000],2,[Over50000],3,[Over100000],[Total Sales])
2. Over100000 = CALCULATE(SUM(Sales[Net Sales]),filter(Sales,SUM(Sales[Net Sales]) > 100000))