I want to have a time series visualization showing the amount of existing open issues per, e.g., week, whose range can be adjusted with the time picker.
Say I have an index with issues, which has openDate, closeDate, and a list of other fields like, team, department that I would use to filter the issues shown in the visualization.
In Kibana it would be trivial to show issues opened or closed each week, as counting events is trivial.
However, showing open issues is counting states. It is not rocket science, if you have a timeStart and timeEnd, the number of open issues is given by the filter:
openDate < timeEnd and (not exists(closeDate) or closeDate>timeStart)
Is there any way of solving this with Kibana? I imagine that it is possible to write such a query with ES, but how to link it to the time picker? how to use the values it return in a visualization, etc....
Related
I've been Googling around this problem for hours and haven't found a solution that suits my needs.
I have a large data set with agent activities and the total time in seconds each activity lasts. I'm pulling this together in a matrix, to display agent names on the left and the start date of each week across the top like so:
This is working as intended (I've used a measure to convert the seconds into hours) but I need the average of the displayed weeks as another column, or to replace the Total column.
I've tried solutions involving DAX measures but none are applicable, likely because I'm using a custom column (WeekStart) to roll up my numbers into weeks. Adding more complexity is I have 2 filters on the matrix; one to exclude any weeks older that 5 weeks in the past and another to exclude any future weeks.
In Excel I'd just add another column next to the table, averaging the 5 cells to the left of it. I could add it to the data table with a SUMIFS checking the Activity date is within the week range and dividing the result by 5. I can't do either of these in PowerBI and I'm new to the software so I'm at a loss as to how to do this.
I have a data set similar to the table below (simplified for brevity)
I need to calculate the total spend per conversion per team for every month, with ability to plot this as time based line chart being an additional nicety. The total spend is equal to the sum of Phone Expenditure, Travel allowance & Misc. Allowance, this can be a calculated field.
I cannot add a calculated field for the ratio, as for some sales person, the number of conversion can be 0 for a given month. So, averaging over team is not option. How can I go about this?
Thanks for help and suggestions in advance!
I've discussed the question with the Harish offline. I've learned that he is trying to calculate ratio per group, not per row.
To perform calculations per group, users can add calculated fields inside a QuickSight analysis and use level aware aggregation expressions. (Note that level aware aggregations can only be used in an analysis, not in the data prep view). Here is a link to the documentation about level aware aggregations if you want to learn more about this area https://docs.aws.amazon.com/quicksight/latest/user/level-aware-aggregations.html
I have weekly sales data from 201601-201835 and i have to create a graph to see the trend. Since the data is categorical, a scroll bar is appearing on the graph. I want to view the complete graph at once.
I tried converting the data to continuous, but there is a gap in the graph as there is no data from 201653 to 201699 and hence the graph is wrong.
Is there a way of viewing the complete data without a scroll bar?
I would add summary fields to the Axis above the Week, e.g. Year, Month, Quarter. You will probably need a reference table for your weeks or some fancy calculations.
With those fields in place, you can expand or drill into the levels before getting down to the Week level. As the higher levels are Categorical and have fewer categories, you are less likely to see scroll bars.
A side benefit is the user has more control e.g. they can drill down on just a section of the weeks, e.g. for one year.
I am from a Software trading company and we are troubleshooting.
We have been using a lot of different brokers and FOREX data providers. We are working with historical data to optimize and improve our software, but we have a big challenge that all of the data we have a sample from have a lot of missing data. When we compare different broker’s data, the data does not match up. But when we download the data from the MT4 and use the closing values, then the data are identical.
Our problem is that when using the MT4 we can only get 5 minute bars about a one year back and when using 15 minutes, we can only get it back to 2014 and we need at least 10 years of data.
By going to different companies that sell these data for example The Tick size that would say 100-300 prices per minutes.
there by we would expect one of the prices within the same minute, would give the same prices as MetaTrader4. But this is not the case...
Even by expanding with several minutes before and after. Tendons gives the same result. The values do not match and may fluctuate over 500 points.
The attached image matches the value 4 times, which seems sporadic. The interesting thing is that the first value in tick size values almost matches the average.
However, the values from tick size cannot be used too much since the one month I checked turned from 0 to over 300 points in deviation.
Some brokers have their own historical data center so you can download their data, even all data they have. Other brokers do not have it so all you can do is to get quotes from MetaQuotes server. I do not want to advertise here, simply go over them and you will find some famous brokers with deep m1 history.
Also try to increase number of bars in mt4 chart and history - that may help to see more history on charts without downloading it
I'm facing a following problem. In Kibana 4 I've created a line chart based on my input from elasticeasrch but I can only display average, min, max instead of an actual value of the field per time, e.g. sent bytes.
Most answears to that question on stackoverflow are about Kibana 3 (How to create value over time chart with Kibana 3?) and seem to include a Histogram on a X axis, yet I can't seem to find one which will enable me to apply them to Kibana 4. I was unable to find the histogram panel and once I click on the discover tab there is the constant Searching loading.
If I have the following fields in my _source:
{"timestamp":"2015-06-02T10:16:44.0855","time":587,"threadName":"Thread Group 1-957","byte":1372,"status":"false","latence":306,"registerCall":"404"}
and I would like to have the number of bytes on the Y-axis and on the X-axis my timestamp.
Any help in the right direction will be appreciated :)
To create a value over time line chart in Kibana, follow these steps:
Go to visualize tab and select line chart
In the X-axis, select X-axis, Aggregation as Date Histogram and then select your timestamp field as the date field.
Next for the Y-Axis, select Sum as the aggregation and then bytes as the field.
For the X axis, what Alcanzar said is good, but as you notice, the Y axis is problematic.
Sum (suggested by "Limit") works, but since it's aggregated, it shows the total used in each aggregated bucket, but that may be meaningless depending on what you are trying to show. Your question isn't clear on what you want, so I'm just guessing here. One hour of requests, each of which ran for one minute and sent 1 megabyte is indeed 60 megabytes-minutes, if you are trying to show total capacity used over than hour (maybe you are paying a bill based on usage per time). On the other hand, if you are trying to show peak usage in each time, it would be wrong.
You said you already looked and Max and Min and they don't meet your needs. I don't suppose Standard Deviation would be any better?
I have the same concern. The best I've been able to do so far is
display Min and Max simultaneously in the Y axis. When they diverge, I know I'm zoomed out too far, so I zoom in until they align.
This is how I know I'm seeing individual events.
In any case, I share your frustration. I too would like to be able to show time series as easily as I can in, say, Excel.