Is there a way to inspect all queries that are submitted to apache iceberg? - apache-iceberg

I am new to Apache iceberg. I would like to know if there is a way I can inspect the queries that are submitted to iceberg. Is there a way to do that?

Strictly speaking, iceberg is not a service and you can't submit tasks to it.
But if you just want to get all the events that try to query the iceberg table, you can create a listener to listen for all the events that take place in iceberg, including scanning of course.
You can take a look at the org.apache.iceberg.events package under iceberg-api module.
Hope it will help you.

Related

Guide/tutorial on how to persistently save data on Spring-Boot with jpa-repositiroies

I have googled so much how to save data persistent (meaning it is still there after I shutdown / restart my apllication).
But every guide there is is "Hey we show you how to use spring-boot with jpa real quick and we use h2 database (in-memory)"
I am looking for a guide who shows the setup to make it possible to use a database that stores the data somewhere that it can be retrieved at any later point in time, even after the application was shut down.
If any of you can provide a link to something like this, I am very grateful!
I think Google can give a lot of examples about that. I am not sure what was your query.
Here are some examples:
https://www.mkyong.com/spring-boot/spring-boot-spring-data-jpa-mysql-example/
https://www.callicoder.com/spring-boot-rest-api-tutorial-with-mysql-jpa-hibernate/
https://spring.io/guides/gs/accessing-data-mysql/
HTH

How can i minimise run time of fetching location details?

I am using GEOIP plugin in my laravel system. All things are correctly working but response time of GEOIP is very more. I want to reduec it.
I tried to fetch simple IP address but it is not worked , because i need to do country validation also.
use \Torann\GeoIP\Facades\GeoIP;
$respondentLocation = GeoIP::getLocation();
I just need quick response nothing else.
Thank you in advance.
I'm not familiar with that particular library but I'm assuming its looking up remote data (hence the speed issues). If so, there isn't a lot you can do outside of caching records, and possibly pre-fetching data (if your scenario allows for that).
Looking at their docs, it appears they do have caching mechanisms in place: http://lyften.com/projects/laravel-geoip/doc/commands.html

How to effectively monitor http in Jenkins

Is there some way effectively monitor http in Jenkins master? Monitor plugin provides some graphs and tables but it is really hard to understand how the end user ‘feels’ while working on the Jenkins web page. Is there any page freezes? What is the maximum delay? Maybe I don’t use the Monitor plugin correctly, so is there any way to harvest such a data from provided graphs?
The monitoring plugin is the one that I use. It tells me which pages are taking the longest time to load/hang/etc. I"m not sure if there is something else out there that can do something like this. Maybe a third party tool like newrelic perhaps.

Please suggest some open source java event handling libraries

I am looking for centralized event processing utility which can listen to events from different applications(possibly running on different app servers), I am searching for an open source solution which I can extend/tailor to may needs. This is what I am planning to do with it -
capture events from different applications
Check for filter condition
Based on filter condition call a webservice to update database or use hibernate or other ORM to update database
It would be helpful if you can suggest some libraries that I can look into,
thanks in advance,
You can use Esper which is an embedable open source complex event processing library

Which workflow engine should I chose for implementing a dynamic reconfiguration of workflows?

I want to be able to interrupt a running workflow instance, say when a new activity is about to be invoked, and extract information both about the structure of the workflow and the data in the particular instance. Then I will consult with an external system and according to its response I will possibly alter the behaviour of the workflow. The options I would like to have are addition/removal of activities and altering parameters for the activities to be invoked.
I am currently struggling with the engine it's best to go with. I have looked at WWF, Apache ODE, Oracle Workflow and Active BPEL and as far as I understand they can all provide me with the options I need. I would really appreciate any recommendations on which one will be the easiest to work with for my purpose and any restrictions either of the above might have that would prevent me from reaching my goal.
Thanks
I am sorry not to directly answer your question, but you may be interested in a state machine framework called Stateless created by Nicholas Blumhardt (AutoFac). I have used this instead of Windows Workflow where I needed to quickly configure my steps for a work flow. I have one configuration file that I alter and can introduce new steps into the workflow quite easily. See my SO answer here for more details.
Essentially you define a state as State<T> and this allows you to persist your state in a database easily.

Resources