FileMaker 2024 – Executive Summary

Claris just released the FileMaker 2024 product line…

And we shall call it FileMaker 21.0.1…

Not because we’re contrary but because the platform goes by two names. FileMaker 2024 is its marketing name. That name will cover many different releases, just as FileMaker 2023, released in April 2023, covered versions 20.1.1 through 20.3.2. Most of these releases brought new features as well as bug fixes. In the case of 20.3.2, we received no new features but an important security patch. I have more about that below.

You can track all releases in the Claris knowledge base. Here is the list of FileMaker Pro releases and the same information for FileMaker Server.

Whole Platform

The Claris Platform is more than FileMaker Pro, Go, WebDirect, and Server. There is also Claris Connect and Claris Studio. All the information here will be about the Claris FileMaker components. Connect and Studio are on their release cycles. For Connect, that is roughly a monthly cadence. You can find all relevant release information here, and for Studio, everything that is new is listed here.

This executive summary will focus only on the FileMaker components. As in previous Executive Summaries, I will not dive deep into all the features, but I will point out separate blog posts we have for those features that we think deserve it.

FileMaker Pro

OS Compatibility

Claris FileMaker Pro drops support for macOS Monterey (12) and supports macOS Ventura (13) and Sonoma (14). On Windows, you need to be on 10 or 11, which hasn’t changed since the previous version.

With this version of FileMaker Pro, you will be able to connect to FileMaker Server version 19.4.2 and up.

Security

Claris worked hard on patching some long-standing vulnerabilities. One of them is something I mentioned in my Engage 2024 presentation: “Are you confident in your app’s security?”.

When you use the Grant Full Access to scripts that contain certain script steps that let users interact with FileMaker functionality, you may inadvertently be exposing a lot more to the user than you intended. This includes giving them the ability to mess about in your tables and fields. The Import Records script step dialog is just one of those:

Specify Import Order in the Import Records script step

In my Engage 2024 presentation, I make the case to be extremely cautious when granting Full Access to scripts. Often, we find that it is the lazy way out instead of crafting the proper privilege set for the users. Don’t be that kind of developer.

If you do need to grant Full Access to a script, add a comment in the script explaining why so that developers who come after you don’t have to guess.

There are other security vulnerabilities that got patched in this version, too. You can read up on them in this white paper by Steven Blackwell and myself.

AI

There was a lot of buzz around AI at February’s Engage 2024. You can watch some of Claris’ content on that on their YouTube channel.

While this new version brings some built-in AI functionality, I want to call out that there is already a lot of AI integration that you can do, as shown in our blog post from early 2023. That blog post shows powerful – and secure! – ways of integrating with ChatGPT.

Claris is embedding the AI functionality deeply into FileMaker’s Draco engine, as per this screenshot from Wade Ju’s Engage 2024 presentation, with a whole new Large Language Model (LLM) connectivity layer in the engine.

Image showing the Large Language Model (LLM)

Clearly, there are more features to come in this area. For now, this is what we have that is new. For this release, the focus is on adding support for vector embeddings and semantic search.

In your script workspace, you will see a new section of script steps:

New 'Artificial Intelligence' section added to the script steps inn the Script Workspace

The Configure Machine Learning Model is not new. It was introduced with 19.0 back in 2020, but the other script steps are new.

Embeddings

Let’s tackle vector embeddings first since that is at the core of a lot of functionality. I like how Wade Ju explained it in his Engage session: think of it as another type of index of your data. As we know, the index that we have on data makes it easier and faster to search for data. Vector embeddings do the same. They create numerical representations of your data so that you can do the types of searches such as “How similar is this to that, how closely related are they?” or to classify text, summarize it, and so on.

Embeddings are the representations or encodings of tokens, such as sentences, paragraphs, or documents. Or put a different way: embeddings are a way to store data of all types (including images, audio files, text, documents, etc.) in number arrays called vectors. Inside your FileMaker file, you can store these embeddings in a text field or in a container field in binary format. The recommendation is to always use a container field because the processing of that binary format is much faster and is smaller in amount of storage space.

These embeddings are then used by the LLM, the Large Language Model, to interpret and generate some output.

Semantic Search

Semantic search is one of those capabilities that is unlocked by all of this. It’s the ability of the model to do more than a literal search for the words that you are typing, but also to interpret them and derive meaning from the natural language you write your question in.

Most of the community content will be focused on integrating with cloud-based AI functionality from OpenAI (ChatGPT) and Anthropic (Claude). However we want to emphasize that you can also deploy your own Large Language Model (LLM) to integrate with so that no data or metadata ever needs to leave your own environment, whether you do that on-premise or self-cloud-hosted. Claris calls this the “Open Source” route (or Open Handler in the graphic above). That is where we will primarily focus our future content.

It’s important to note that Claris uses the same kind of approach as we did in our blog post from last year: no data is sent to the LLM, only metadata. Enough metadata about the schema of your solution so that the LLM can return a valid SQL query that FileMaker can execute to get you the response you were prompting it for. When you see references to DDL (Data Definition Language), that is your metadata.

You might spot this as one of the new functions:

GetTableDDL ( tableOccurrenceNames ; ignoreError )

GetTableDDL script - Returns table information in Data Definition Language (DDL) format for a list of table occurrences specified as a JSON array.

Using an On-prem LLM for AI Semantic Search in FileMaker 21

Execute Data API: Create, Update, Duplicate and Delete

This is a huge feature. For years, we’ve been pining for a way to manipulate data in a context-less fashion. Meaning that we wanted to break free from having to navigate to a particular layout just so we could touch the data that belongs to the underlying table of that layout’s table occurrence.

For reading data we have been able to do this through the ExecuteSQL() function and the Execute FileMaker Data API script step. But those could not create, edit, or delete data. And now we can, with the updated Execute FileMaker Data API script step. And for the record – because there is still a lot of confusion about this script step – this does not require the file to be hosted or the server to have the Data API enabled. This script step works internally inside the FileMaker file.

Until now, we have been limited to using the read action in the instructions we sent to the script step to retrieve a single record or do a search. But now you can use the edit, delete, create, and duplicate actions.

See our in-depth blog post about this functionality and some considerations around Transactions and performance.

This feature might just change parts of how we build things with the FileMaker platform.

XML

There used to be a time when I was very good at writing XSLT stylesheets, the things required to import XML from other systems into FileMaker and/or to transform FileMaker’s XML grammar into the XML syntax that other systems required.

Specify XML and XSL Options dialog

Most of our integration work these days is through REST APIs and JSON, so XML has not been that prominent. But the need for it has not gone away. Under the hood, Claris has replaced the main libraries that it uses for processing XML and XSLT (Xerces with libxml2 and Xalan with libxslt). In addition to overall better performance, those new libraries allow for a bunch of new functionality in the form of additional extension elements and functions. See, as a reference. If you process a lot of XML, then definitely keep an eye on the Claris community because there will be some interesting content for you.

Save as XML

Claris itself uses a lot of XML. The Database Design Report, for instance, produces XML. So does the Save as XML script step (SaXML). Both of these output your solution’s schema elements (tables, fields, scripts, layouts, relationships, value lists, etc.) in an XML format. The SaXML format is becoming more important, and we have a dedicated blog post about it here.

JSON Functions

Most coding environments have an efficient way of using arrays by providing you with an easy way to find the last element in the array, remove it, and add something to the end of an array.

Before this version, you would always have to take a detour by figuring out how many elements were in the array so that you could address the last one. You’d typically use JsonListKeys() for this, but now you can directly reference the last element in an array with the [:] syntax or add an element to the end of an array with the [+].

Additionally, there is also a new JsonMakeArray() function that lets you easily create an array from any form of delimited list.

This blog post explains these new features in lot of detail.

Miscellaneous

Learn about the improvements made for “open quickly” first introducted in FileMaker 19.0:

Navigating These Updates with a Development Partner

Our team of FileMaker consultants are getting familiar with this new release and can help you explore new features and navigate what they mean for your application. If you’d like to talk with one of our team members, reach out to us.

4 thoughts on “FileMaker 2024 – Executive Summary”

    1. We have; there isn’t a simple rule here that says that one is better than the other. eSQL tends to have a higher first-run penalty and a faster subsequent-run performance. Unless you start adding SQL functions and JOINs to the query, or you are hit by the “open record penalty”. Generally, the performance difference is in the range of tens of milliseconds so for all practical purposes it makes no difference unless you do these operations in big loops.

  1. Great warning about granting scripts [Full Access]. I really avoid them and really good Import example of the vulnerability which would be easy to overlook and then taken advantage of. There is a time/place for them, but it is few and far between. It is like those who make the first step of a script to turn on Error Capture (grrrr).

Leave a Comment

Your email address will not be published. Required fields are marked *

Scroll to Top