Skip to main content
Version: v2.x

BigQuery: Native Queries

Available on: Cloud Professional, Cloud Enterprise, Self-Hosted Enterprise

What are Native Queries?​

Supported from

Native queries are supported from v2.26.0.

The Hasura GraphQL Engine automatically generates a GraphQL API around database objects. That includes querying, mutating, and subscribing to data changes and events. However, sometimes we need more custom or advanced behavior that doesn’t come out of the box.

Native Queries allows you to automatically generate a GraphQL API around raw SQL queries, giving you more flexibility and control over your Hasura-generated GraphQL schema. They allow you to harness the full power of SQL within Hasura without the need to create database objects that require DDL privileges.

You might find Native Queries useful for many reasons:

  • Use the full power of SQL that Hasura might not provide access to through the typical table API, such as GROUP BY, window functions, or scalar functions.
  • Provide custom arguments to the users of your API to greatly expand its flexibility.
  • Encapsulate sophisticated filtering with a query, allowing your users to provide a single argument rather than having to understand how to manipulate the data.
  • Work with the advanced features of your database to improve performance.
  • Write a compatibility layer around tables, making it easier to change your API without breaking existing clients.
  • Reduce duplication by moving common data manipulation into one place.

Native Queries are a Cloud and Enterprise feature of Hasura.

Supported features

Currently, Hasura aggregations are not supported, but you can write the aggregation yourself as part of the query.

Relationships will be supported in a future release.

Example: excerpts of articles​

We’ll start with an example. Let’s use this new feature to add some custom functionality to our Hasura API, without needing to define a custom SQL function on the database. If you’d like some reference documentation, scroll down, and also take a look at the Logical Models documentation.

Imagine we have some articles in a table, with content kindly donated by Loripsum.net:

CREATE TABLE article(
  id SERIAL NOT NULL PRIMARY KEY,
  title TEXT NOT NULL,
  date DATE NOT NULL,
  content TEXT NOT NULL
);

INSERT INTO article(title, date, content) VALUES
  ('You will not believe', '2023-01-01', 'Lorem ipsum dolor sit amet, consectetur adipiscing elit. Facillimum id quidem est, inquam. Esse enim, nisi eris, non potes. Oratio me istius philosophi non offendit; Idemne, quod iucunde? Quid est enim aliud esse versutum? Non autem hoc: igitur ne illud quidem.'),
  ('Ten things that', '2023-02-02', 'Illi enim inter se dissentiunt. Sedulo, inquam, faciam. Simus igitur contenti his.'),
  ('Did you know', '2023-03-03', 'Ratio quidem vestra sic cogit. Duo Reges: constructio interrete. An nisi populari fama? Erat enim res aperta. Apparet statim, quae sint officia, quae actiones. Tum mihi Piso: Quid ergo?'),
  ('They just cannot', '2023-04-04', 'Itaque hic ipse iam pridem est reiectus; Quod quidem iam fit etiam in Academia. Negare non possum. Quis non odit sordidos, vanos, leves, futtiles?'),
  ('What on earth', '2023-05-05', 'Venit ad extremum; At certe gravius. Efficiens dici potest. Rhetorice igitur, inquam, nos mavis quam dialectice disputare? Nunc de hominis summo bono quaeritur; Rationis enim perfectio est virtus;');

When listing these articles in an index, we probably want to truncate the text to, let’s say, 20 characters. So let’s create a Logical Model representing the excerpted article:

Click on the Logical Models tab, and on the Add Logical Model button.

Create Logical Model

Once the modal is open, fill in the form. Each added field will be returned as a field in the GraphQL schema.

Create Logical Model

We can then track a Native Query that takes a single argument, max_length, and uses it to truncate the article content (more on arguments below). We use the SQL substring function to truncate the function, and the length function to decide whether we should use an ellipsis.

We use {{max_length}} to refer to the argument. We need it twice, so we simply use the argument twice.

Click on the Native Queries tab and Create Native Query button.

Create Native Query

Fill in the form with the data required:

  • Native Query name article_with_excerpt
  • The database to be used
  • The input parameter max_length
  • The Native Query statement
SELECT id, title, (substring(content, 1, {{max_length}}) || (CASE WHEN length(content) < {{max_length}} THEN '' else '...' END)) AS excerpt, date
FROM article
  • The query return type, the Logical Model previously created article_excerpt
Create Native Query Form

All that’s left is for us to make a GraphQL query to select some articles with excerpts using our new root field generated in the previous API call. All we need to provide is the date range we’re interested in:

query {
  article_with_excerpt(args: { max_length: 20 }, where: { date: { _gte: "2023-03-01" } }) {
    id
    title
    date
    excerpt
  }
}

When we run this GraphQL query, we get the following results:

{
  "data": {
    "article_with_excerpt": [
      {
        "id": 3,
        "title": "Did you know",
        "date": "2023-03-03",
        "excerpt": "Ratio quidem vestra ..."
      },
      {
        "id": 4,
        "title": "They just cannot",
        "date": "2023-04-04",
        "excerpt": "Itaque hic ipse iam ..."
      },
      {
        "id": 5,
        "title": "What on earth",
        "date": "2023-05-05",
        "excerpt": "Venit ad extremum; A..."
      }
    ]
  }
}

Creating a Native Query​

1. Create a Logical Model​

In order to represent the structure of the data returned by the query, we first create a Logical Model.

Permissions and Logical Models

Note that this Logical Model has no attached permissions and therefore will only be available to the admin role. See the Logical Model documentation for information on attaching permissions.

To get started choose Native Queries from the sidebar in the Data tab:

Create Logical Model

Click on the Logical Models tab, and on the Add Logical Model button.

Create Logical Model

Once the modal is open, fill in the forms with:

  • The database to use as source
  • The Logical Model name
  • The optional input fields
Create Logical Model

2. Create a Native Query​

Once the Logical Model is defined, we can use it to define the query:

Click on the Native Queries tab and Create Native Query button.

Create Native Query

Fill in the form with the data required:

  • Native Query name
  • An optional comment
  • The database to be used
  • Optional input parameters to be send to the Native Query
  • The Native Query statement
  • The query return type (the Logical Model previously created)
Create Native Query Form

You can use any SQL that you could potentially use in a parameterized query, with the following caveats:

  • The query must currently be a single read-only SQL query.
  • The query must be a valid standalone query, and not a partial query.
  • The return type of the query must match with the Logical Model.
  • The SQL cannot invoke a stored procedure.

Arguments​

The query can take arguments, which are specified in the metadata. These arguments can be used in the SQL using the syntax {{argument_name}}. This syntax resembles popular string templating languages such as Mustache, but does not use string interpolation. Instead, it works in exactly the same way as parameterized queries in the database, and so arguments do not need escaping or quoting in the SQL itself. They will be treated as variables of the correct type.

This does mean that arguments cannot be used for elements of the SQL that deal with structure. For example, you cannot use an argument to specify the name of the table in a FROM clause.

When making a query, the arguments are specified using the args parameter of the query root field.

Example: LIKE operator​

A commonly used operator is the LIKE. When used in a WHERE condition, it's usually written with this syntax WHERE Title LIKE '%word%'.

In order to use it with Native Query arguments, you need to use this syntax LIKE ('%' || {{searchTitle}} || '%'), where searchTitle is the Native Query parameter.

Using the Native Query​

You can make a GraphQL request using the specified root field name just as you would any other GraphQL query. When making a query, the arguments are specified using the args parameter of the query root field.

query {
  <root field name>(
    [args: {"<argument name>": <argument value>, ...},]
    [where: ...,]
    [order_by: ..., distinct_on: ...,]
    [limit: ..., offset: ...]
  ) {
    <field 1>
    <field 2>
    ...
  }
}

Query functionality​

Just like tables, Native Queries generate GraphQL types with the ability to further break down the data. You can find more information in the relevant documentation for filtering, sorting, distinct queries, and pagination.

Mutations​

Currently, only read-only queries are supported. All queries are run in a read-only transaction where supported to enforce this constraint.

A future release will allow mutations to be specified using Native Queries.

Permissions​

Native queries will inherit the permissions of the Logical Model that they return. See the documentation on Logical Models for an explanation of how to add permissions.

Relationships​

Relationships are supported between Native Queries.

Unlike tables, relationships for a Native Query have to be given as part of tracking the Native Query.

Currently relationships are only supported between Native Queries and tables residing in the same source.

As an example, consider the following Native Queries which implement the data model of articles and authors given in the section on Logical Model references:

POST /v1/metadata HTTP/1.1
Content-Type: application/json
X-Hasura-Role: admin

{
  "type": "bulk_atomic",
  "args": [
    {
      "type": "bigquery_track_logical_model",
      "args": {
        "description": "",
        "fields": [
          {
            "name": "id",
            "nullable": false,
            "type": "INT64"
          },
          {
            "name": "title",
            "nullable": false,
            "type": "VARCHAR"
          },
          {
            "name": "author_id",
            "nullable": false,
            "type": "INT64"
          }
        ],
        "name": "article",
        "source": "bigquery"
      }
    },
    {
      "type": "bigquery_track_logical_model",
      "args": {
        "description": "",
        "fields": [
          {
            "name": "id",
            "nullable": false,
            "type": "INT64"
          },
          {
            "name": "name",
            "nullable": false,
            "type": "VARCHAR"
          }
        ],
        "name": "author",
        "source": "bigquery"
      }
    },
    {
      "type": "bigquery_track_native_query",
      "args": {
        "arguments": {},
        "array_relationships": [],
        "code": "SELECT * FROM (VALUES (1, 'Logical Models', 1), (2, 'Native Queries', 2), (3, 'Relationships', 3), (4, 'Graph Relationships', 4), (5, 'Permissions', 5)) as t(\"id\", \"title\", \"author_id\")",
        "object_relationships": [
          {
            "name": "author",
            "using": {
              "column_mapping": {
                "author_id": "id"
              },
              "insertion_order": null,
              "remote_native_query": "author"
            }
          }
        ],
        "returns": "article",
        "root_field_name": "article",
        "source": "bigquery",
        "type": "query"
      }
    },
    {
      "type": "bigquery_track_native_query",
      "args": {
        "arguments": {},
        "array_relationships": [
          {
            "name": "articles",
            "using": {
              "column_mapping": {
                "id": "author_id"
              },
              "insertion_order": null,
              "remote_native_query": "article"
            }
          }
        ],
        "code": "SELECT * FROM (VALUES (1, 'Tom'), (2, 'Dan'), (3, 'Philip'), (4, 'Gil'), (5, 'Samir')) as t(\"id\", \"name\")",
        "object_relationships": [],
        "returns": "author",
        "root_field_name": "author",
        "source": "bigquery",
        "type": "query"
      }
    }
  ]
}
Wrap calls in bulk_atomic

Similar to Logical Models, tracking the Native Queries one-by-one would fail, since get_articles refers to get_authors, which is not yet defined.

Tracking the Native Queries in one atomic operation postpones coherency checks until all models are tracked, which allows for mutual references.

Relationships with tables​

Relationships can be defined between tables and Native Queries residing in the same source.

As an example, given a table authors, consider the following definition of Logical Models and Native Queries:

POST /v1/metadata HTTP/1.1
Content-Type: application/json
X-Hasura-Role: admin

{
  "type": "bulk_atomic",
  "args": [
    {
      "type": "bigquery_track_logical_model",
      "args": {
        "description": "",
        "fields": [
          {
            "name": "id",
            "nullable": false,
            "type": "integer"
          },
          {
            "name": "title",
            "nullable": false,
            "type": "text"
          },
          {
            "name": "author_id",
            "nullable": false,
            "type": "integer"
          }
        ],
        "name": "article",
        "source": "default"
      }
    }
    {
      "type": "bigquery_track_native_query",
      "args": {
        "arguments": {},
        "array_relationships": [],
        "code": "SELECT * FROM (VALUES (1, 'Logical Models', 1), (2, 'Native Queries', 2), (3, 'Relationships', 3), (4, 'Graph Relationships', 4), (5, 'Permissions', 5)) as t(\"id\", \"title\", \"author_id\")",
        "object_relationships": [
          {
            "name": "author",
            "using": {
              "column_mapping": {
                "author_id": "id"
              },
              "insertion_order": null,
              "remote_table": "authors"
            }
          }
        ],
        "returns": "article",
        "root_field_name": "get_articles",
        "source": "default",
        "type": "query"
      }
    }
  ]
}

Start with GraphQL on Hasura for Free

  • Build apps and APIs 10x faster
  • Built-in authorization and caching
  • 8x more performant than hand-rolled APIs
Try GraphQL with Hasura
Promo
Loading...
Loading...