> For the complete documentation index, see [llms.txt](https://cortex-docs.paloaltonetworks.com/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://cortex-docs.paloaltonetworks.com/cortex-xsiam/detect-investigate-and-respond-to-threats/investigation-and-response/build-xql-queries/federated-search.md).

# Federated Search

Federated Search is a query mechanism designed to provide unified access to distributed data sources without requiring pre-ingestion or centralization. This capability enables you to query data in place, significantly reducing the complexity and operational costs associated with the ingestion process and long-term data retention.

{% hint style="info" %}
**NOTE:**

Federated Search is not enabled by default. To enable it in your tenant, contact your Customer Support Team.
{% endhint %}

Modern enterprises store massive volumes of data across multiple cloud providers and hybrid environments. Centralized data ingestion and warehousing may be insufficient or expensive for cold or regulatory-mandated data. Federated Search allows you to:

* De-couple data management from data analytics for cost optimization.
* Maintain economic solutions for long-term data storage.
* Perform on-demand incident response or compliance audits against existing long-term storage solutions without the overhead of ingestion.

The main use cases for Federated Search include:

* Incident Investigation: Querying events that occurred a long time ago, where the data might not have been ingested into Cortex XSIAM.
* Compliance audits: Accessing historical data needed for audits without the need for extensive ingestion.
* Long-Term data storage: Providing an integrated solution for retaining data for many years.
* Data linking: Joining external datasets with ingested datasets for comprehensive and unified data analysis.

You can keep non-critical, high-volume data types in their native storage locations while preserving the ability to query this data using Cortex Query Language (XQL). This ensures that visibility is gained into a broader spectrum of data while maintaining the core value proposition of deep analytics on ingested data.

{% hint style="info" %}
**NOTE:**

Federated search queries consume compute units, which are calculated according to timeframe, complexity, and any cross-cloud egress costs that may apply.
{% endhint %}

### Supported configurations

Federated Search supports the following configurations.

<table><thead><tr><th width="210">PROPERTY</th><th>CONFIGURATION</th></tr></thead><tbody><tr><td>Storage solutions</td><td>Amazon Web Services (AWS) S3<br>Google Cloud Storage (GCS)<br>Azure Blob Storage</td></tr><tr><td>Formats</td><td>CSV<br>Parquet<br>JSONL<br><br><strong>NOTE:</strong><br>For optimal results, we recommend the Parquet format. Federated Search supports certain use cases of gzip compressed files. For additional information, please contact your support agent.</td></tr><tr><td>Partitioning/File Structure</td><td>Your data must be partitioned and must follow the Hive partitioning format, which uses key-value pairs. Partitions must be named in the yyyy-mm-dd format (for example, ds=2023-07-07).</td></tr><tr><td>Supported Regions</td><td><strong>AWS:</strong> us-east-1, us-west-2, ap-northeast-2, ap-southeast-2, eu-west-1, eu-central-1<br><br><strong>GCS:</strong> africa-south1, asia-east1, asia-east2, asia-northeast1, asia-northeast2, asia-northeast3, asia-south1, asia-south2, asia-southeast1, asia-southeast2, australia-southeast1, australia-southeast2, europe-central2, europe-north1, europe-north2, europe-southwest1, europe-west1, europe-west10, europe-west12, europe-west2, europe-west3, europe-west4, europe-west5, europe-west8, europe-west9, me-central1, me-central2, me-west1, northamerica-northeast1, northamerica-northeast2, northamerica-south1, southamerica-east1, southamerica-west1, us-central1, us-east1, us-east4, us-east5, us-south1, us-west1, us-west2, us-west3, us-west4<br><br><strong>Azure Blob Storage:</strong> eastus2<br><br><strong>NOTE:</strong><br>The list of supported regions may change in the future.</td></tr></tbody></table>

### Limitations

The following limitations apply to Federated Search:

<table><thead><tr><th width="156">LIMITATION</th><th>DESCRIPTION</th></tr></thead><tbody><tr><td>Regions</td><td>If your tenant is on a specific region server (and not on a multi-region server), the bucket must be in the same region as your tenant.<br><br>If your tenant is on a multi-region server, you can only configure regions that are in the multi-region of your tenant. The bucket must be in the same multi-region as your Cortex tenant. For example, if your Cortex XSIAM tenant is located in the US multi-region, you can configure an external dataset only from regions in the US multi-region.</td></tr><tr><td>Queries</td><td><p>The following functions are not available in Federated Search and remain exclusive to fully ingested data:<br><br></p><ul><li>Complex, cross-source analytical functions, for example correlations, widgets, dashboards, playbooks, and APIs.</li><li>search, target and view XQL stages.</li></ul></td></tr></tbody></table>


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter, and the optional `goal` query parameter:

```
GET https://cortex-docs.paloaltonetworks.com/cortex-xsiam/detect-investigate-and-respond-to-threats/investigation-and-response/build-xql-queries/federated-search.md?ask=<question>&goal=<endgoal>
```

`ask` is the immediate question: it should be specific, self-contained, and written in natural language.
`goal` is optional and describes the broader end goal you are ultimately trying to accomplish on behalf of the user. GitBook uses it to tailor the answer towards what is most useful for that goal.

The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.
