Elasticsearch search with nested properties - elasticsearch

Question

I have an instance in which articles are stored which have various properties. But it may be that some items have no properties at all. There are countless properties and assigned values, all in random order.
Now the problem is that unfortunately it doesn't work the way I would like it to. The properties are respected, but it seems like the order of the properties is important. But it can be that there are a lot of properties in the entry in the instance and only 1-2 are queried in the search query and these can have minor deviations in the value.
The goal is to find entries that are as similar as possible, no matter the order of the properties.
Can anyone help me with this?
Elastic instance info:
"_index" : "articles",
"_type" : "_doc",
"_id" : "fYjaQXkBBdCju4scstN_",
"_score" : 1.0,
"_source" : {
"position" : "400.000",
"beschreibung" : "asc",
"menge" : 24.0,
"einheit" : "St",
"properties" : [
{
"desc" : "Farbe",
"val" : "rot"
},
{
"desc" : "Material",
"val" : "Holz"
},
{
"desc" : "Länge",
"val" : "20 cm"
},
{
"desc" : "Breite",
"val" : "100 km"
}
]
}
}
The nested part of my current query:
[nested] => Array
(
[path] => properties
[query] => Array
(
[0] => Array
(
[0] => Array
(
[bool] => Array
(
[should] => Array
(
[0] => Array
(
[match] => Array
(
[properties.desc] => Farbe
)
)
[1] => Array
(
[match] => Array
(
[properties.val] => rot
)
)
)
)
)
)
[1] => Array
(
[0] => Array
(
[bool] => Array
(
[should] => Array
(
[0] => Array
(
[match] => Array
(
[properties.desc] => Länge
)
)
[1] => Array
(
[match] => Array
(
[properties.val] => 22 cm
)
)
)
)
)
)
[2] => Array
(
[0] => Array
(
[bool] => Array
(
[should] => Array
(
[0] => Array
(
[match] => Array
(
[properties.desc] => Material
)
)
[1] => Array
(
[match] => Array
(
[properties.val] => Holz
)
)
)
)
)
)
)
)

Answer 1

There are two problems in your query leading to strange results:
You're using a match query on a text field, which has multiple terms. So when doing a
"match": {
"properties.val": "22 cm",
}
, Elasticsearch searches for "22" OR "cm" in the properties.val field. I assume you wanna match on the whole phrase, so you could for example use match_phrase here. Alternatively, you could put the unit into an own field. Another option would be to use the operator parameter:
"match": {
"properties.val": {
"query": "20 cm",
"operator": "and"
}
}
But be aware that this isn't looking for exact phrase. For example "20 30 cm" would also be matched, but maybe this could suit your case.
You're using the should clause on the property level. So you're basically asking for documents with properties, that "should have Farbe in their description and rot in their value", but that would match all following examples:
"properties" : [
{
"desc" : "Farbe",
"val" : "blau"
}
]
"properties" : [
{
"desc" : "Material",
"val" : "rot"
}
]
"properties" : [
{
"desc" : "Farbe",
"val" : "blau"
},
{
"desc" : "Material",
"val" : "rot"
}
]
So you need a bool query (having must or filter clauses) for each property you wanna match and a bool query around that having a should clause for each property. Your query from the question could then be like this:
{
"query": {
"bool": {
"should": [
{
"nested": {
"path": "properties",
"query": {
"bool": {
"filter": [
{
"match": {
"properties.desc": "Farbe"
}
}
],
"must": [
{
"match_phrase": {
"properties.val": "rot"
}
}
]
}
}
}
},
{
"nested": {
"path": "properties",
"query": {
"bool": {
"filter": [
{
"match": {
"properties.desc": "Länge"
}
}
],
"must": [
{
"match_phrase": {
"properties.val": "22 cm"
}
}
]
}
}
}
},
{
"nested": {
"path": "properties",
"query": {
"bool": {
"filter": [
{
"match": {
"properties.desc": "Material"
}
}
],
"must": [
{
"match_phrase": {
"properties.val": "Holz"
}
}
]
}
}
}
}
]
}
}
}
Please try, if this gives the desired results.
You could still tweak the query for example by using minimum_should_match or defining the score given by each matched property.