tag:blogger.com,1999:blog-6061887630060661987.post8477851648946415830..comments2024-03-13T13:54:35.259-04:00Comments on dlib C++ Library: MITIE: A completely free and state-of-the-art information extraction toolDavis Kinghttp://www.blogger.com/profile/16577392965630448489noreply@blogger.comBlogger23125tag:blogger.com,1999:blog-6061887630060661987.post-34294672326958069502018-10-22T21:33:38.008-04:002018-10-22T21:33:38.008-04:00You have to install the python header files. If y...You have to install the python header files. If you google your error you will get a whole lot of hits.Davis Kinghttps://www.blogger.com/profile/16577392965630448489noreply@blogger.comtag:blogger.com,1999:blog-6061887630060661987.post-17261994188781352442018-02-28T02:28:56.543-05:002018-02-28T02:28:56.543-05:00Hi I am using mitie ner. But now I am facing perfo...Hi I am using mitie ner. But now I am facing performance issue. I am using 5 core machine with 8 GB ram. I have 200 number of sentences with labels.but problem is , it is taking time more than 1 hours.<br /><br />What could be the possible mistake I am doing ?<br /><br />Thanks in advance.Achyutahttps://www.blogger.com/profile/07280990107022263738noreply@blogger.comtag:blogger.com,1999:blog-6061887630060661987.post-27918615362393718662018-02-28T02:18:41.316-05:002018-02-28T02:18:41.316-05:00@Julien Martin . Did you get any solution for this...@Julien Martin . Did you get any solution for this problem ?Achyutahttps://www.blogger.com/profile/07280990107022263738noreply@blogger.comtag:blogger.com,1999:blog-6061887630060661987.post-13722433584307137682017-01-28T05:13:29.744-05:002017-01-28T05:13:29.744-05:00This looks promising!This looks promising!Pradeep Sharmahttps://www.blogger.com/profile/16391204004544553545noreply@blogger.comtag:blogger.com,1999:blog-6061887630060661987.post-12158650085727473952016-09-19T12:15:07.509-04:002016-09-19T12:15:07.509-04:00I think the question was clear from the beginning;...I think the question was clear from the beginning; so is the answer now :)<br /><br />Thanks anywayAnonymoushttps://www.blogger.com/profile/03860894759747364038noreply@blogger.comtag:blogger.com,1999:blog-6061887630060661987.post-86585559933084338942016-09-19T12:07:45.857-04:002016-09-19T12:07:45.857-04:00Let's be clear, you are asking about multi-cor...Let's be clear, you are asking about multi-core processing. Yes, I'm sure it's possible to make MITIE take better advantage of multi-core CPUs. I'm not going to be doing that myself any time soon though. But pull requests are always welcome :)Davis Kinghttps://www.blogger.com/profile/16577392965630448489noreply@blogger.comtag:blogger.com,1999:blog-6061887630060661987.post-28756144857917700002016-09-19T10:13:14.920-04:002016-09-19T10:13:14.920-04:00Do you think you decouple models from extractors s...Do you think you decouple models from extractors so that one model can be reused by different NamedEntityExtractor instances as it is the case for OpenNLP?<br /><br />Thanks!Anonymoushttps://www.blogger.com/profile/03860894759747364038noreply@blogger.comtag:blogger.com,1999:blog-6061887630060661987.post-86462392148416221642016-09-19T10:02:52.042-04:002016-09-19T10:02:52.042-04:00The documentation is correct. You can't share...The documentation is correct. You can't share objects between threads without synchronization. Davis Kinghttps://www.blogger.com/profile/16577392965630448489noreply@blogger.comtag:blogger.com,1999:blog-6061887630060661987.post-15669242319577303102016-09-19T09:43:58.864-04:002016-09-19T09:43:58.864-04:00Hi Davis,
Thanks for this great piece of software...Hi Davis,<br /><br />Thanks for this great piece of software. <br /><br />I'd like to run multiple instances of MITIE NamedEntityExtractor (from Java) in parallel but I can't afford to load as many model instances as extractor instances.<br /><br />The documentation from mitie.h (1) seems to state that NamedEntityExtractor shall not be used concurrently. Is that right?<br /><br />Then, is there at least any means to reuse a loaded model; ie, not to load a new model instance in memory (say english) for each new NamedEntityExtractor instance? <br /><br />Thanks very much by advance,<br />Julien<br /><br />(1) https://github.com/mit-nlp/MITIE/blob/master/mitielib/include/mitie.hAnonymoushttps://www.blogger.com/profile/03860894759747364038noreply@blogger.comtag:blogger.com,1999:blog-6061887630060661987.post-17836482524671351882016-05-04T18:08:46.865-04:002016-05-04T18:08:46.865-04:00Stefan, what have you found?Stefan, what have you found?lunakidhttps://www.blogger.com/profile/05519280462728996030noreply@blogger.comtag:blogger.com,1999:blog-6061887630060661987.post-71189171782818825452015-11-18T16:50:20.090-05:002015-11-18T16:50:20.090-05:00In mitie there is steam.c. I'll check that.In mitie there is steam.c. I'll check that.Stefanelushttps://www.blogger.com/profile/08306038092629239457noreply@blogger.comtag:blogger.com,1999:blog-6061887630060661987.post-67845840000120678622015-11-18T16:45:54.632-05:002015-11-18T16:45:54.632-05:00Hi Davis,
It is possible to do stemming with dli...Hi Davis, <br /><br />It is possible to do stemming with dlib and extract symbols and stuff ? I trying to extract a feature descriptor from sentences and run it in a classifier from dlib. <br /><br />StefanStefanelushttps://www.blogger.com/profile/08306038092629239457noreply@blogger.comtag:blogger.com,1999:blog-6061887630060661987.post-40959030456448345872014-09-04T12:07:18.918-04:002014-09-04T12:07:18.918-04:00Fantastic! Very nicely done... Thank you and congr...Fantastic! Very nicely done... Thank you and congratulations.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-6061887630060661987.post-4259232560225412622014-06-21T18:27:00.234-04:002014-06-21T18:27:00.234-04:00The model that comes with MITIE is trained based o...The model that comes with MITIE is trained based on the CoNLL 2003 shared task so we did that evaluation and got an F1 score of 88.1 which is quite good. https://github.com/mit-nlp/MITIE/wiki/EvaluationDavis Kinghttps://www.blogger.com/profile/16577392965630448489noreply@blogger.comtag:blogger.com,1999:blog-6061887630060661987.post-10084409931231020702014-06-21T15:55:59.003-04:002014-06-21T15:55:59.003-04:00Any benchmarks that you have done against existing...Any benchmarks that you have done against existing named entity annotation data sets like ACE or CoNLL ?Sudarshanhttps://www.blogger.com/profile/15961446288916656876noreply@blogger.comtag:blogger.com,1999:blog-6061887630060661987.post-25623544573384801712014-06-21T15:55:58.540-04:002014-06-21T15:55:58.540-04:00This comment has been removed by the author.Sudarshanhttps://www.blogger.com/profile/15961446288916656876noreply@blogger.comtag:blogger.com,1999:blog-6061887630060661987.post-24684973081886176122014-06-21T15:55:54.464-04:002014-06-21T15:55:54.464-04:00This comment has been removed by the author.Sudarshanhttps://www.blogger.com/profile/15961446288916656876noreply@blogger.comtag:blogger.com,1999:blog-6061887630060661987.post-72410324413047406032014-06-08T09:59:45.229-04:002014-06-08T09:59:45.229-04:00That file ends with a UNIX line ending. Normally ...That file ends with a UNIX line ending. Normally ^M appears when there is also the byte for line endings used by windows but it's not in MITIE's git repo that way. Maybe you have setup git to convert line endings on files, are using windows, and the git command gets upset about seeing windows line ending patterns?Davis Kinghttps://www.blogger.com/profile/16577392965630448489noreply@blogger.comtag:blogger.com,1999:blog-6061887630060661987.post-64752680935907025382014-06-08T09:59:42.450-04:002014-06-08T09:59:42.450-04:00That file ends with a UNIX line ending. Normally ...That file ends with a UNIX line ending. Normally ^M appears when there is also the byte for line endings used by windows but it's not in MITIE's git repo that way. Maybe you have setup git to convert line endings on files, are using windows, and the git command gets upset about seeing windows line ending patterns?Davis Kinghttps://www.blogger.com/profile/16577392965630448489noreply@blogger.comtag:blogger.com,1999:blog-6061887630060661987.post-30112838995923118992014-06-08T07:41:37.732-04:002014-06-08T07:41:37.732-04:00When I am trying to execute ./fetch_submodules.sh,...When I am trying to execute ./fetch_submodules.sh, it's failing complaining about git command proper usage. Can you please confirm this, I am not sure how ^M is present at the end of line: git submodule update --init^M<br />Asterisk14https://www.blogger.com/profile/05947393245304701786noreply@blogger.comtag:blogger.com,1999:blog-6061887630060661987.post-35466406295291754092014-05-09T01:17:20.188-04:002014-05-09T01:17:20.188-04:00Can't wait for the Java release! Thanks for sh...Can't wait for the Java release! Thanks for sharingAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-6061887630060661987.post-42034282635187351002014-04-29T13:51:52.631-04:002014-04-29T13:51:52.631-04:00Running make examples should compile ner_stream. ...Running make examples should compile ner_stream. Did you do that step or is that not working on your computer?Davis Kinghttps://www.blogger.com/profile/16577392965630448489noreply@blogger.comtag:blogger.com,1999:blog-6061887630060661987.post-27531485875241921682014-04-17T03:14:33.535-04:002014-04-17T03:14:33.535-04:00Thanks for this post. I tried following your instr...Thanks for this post. I tried following your instructions, however it seems that in your minimal example, a `make ner_stream` step is missing.Marco Luihttps://www.blogger.com/profile/10192631418200993311noreply@blogger.com