'async appears to not use multiple threads C++
my async calls appear to run in serial execution .. leaving me to believe Im not doing something correctly in the code or.. perhaps not understanding something
At a high level I take in 100,000 or so strings, use them to perform a query rate limited to 1 per second per connection.. I am starting with 4 connections to the service and want to use all 4 concurrently .. wait for all their answers to come back and then combine the results
Main.cpp
struct DataFetcher {
DataFetcher(cpool::ConnectionPool& tws_conn_pool): conn_pool(&conn_pool){
std::cout << "DataFetcher() this->conn_pool == "<< this->conn_pool << std::endl;
}
std::vector<std::string> process_data(std::vector<std::string> sub_batch_vector){
std::for_each(sub_batch_vector.begin(), sub_batch_vector.end(),[](std::string query_str){
std::cout << query_str << ";";
std::this_thread::sleep_for (std::chrono::seconds(1));
});
cpool::ConnectionPool::ConnectionProxy proxy_conn = this->my_conn_pool->get_connection();
proxy_conn->is_healthy();
// will do more stuff later here
return sub_batch_vector;
}
cpool::ConnectionPool * const tws_conn_pool;
};
What is the proper way to use this async call within a loop.. there will be a variable number of ServiceConnections available so I'd like to do something like this
std::vector<std::future<std::vector<std::string>>> results_vector;
for (int i=0 ; i < this->tws_conn_pool->size()-1; i++) {
std::vector<std::string> subvector = {queries_list.begin() + (batch_size*i), queries_list.begin() + (batch_size*(i+1))};
DataFetcher fetcher = DataFetcher(*this->conn_pool);
auto fut = std::async(std::launch::async, &DataFetcher::process_data, &fetcher, subvector);
results_vector.push_back(fut);
}
but this seems very obtuse and doesn't actually compile..
from /Server/cpp_server/src/_server.cpp:1:
/usr/include/c++/9/ext/new_allocator.h: In instantiation of ‘void __gnu_cxx::new_allocator<_Tp>::construct(_Up*, _Args&& ...) [with _Up = std::future<std::vector<std::__cxx11::basic_string<char> > >; _Args = {const std::future<std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > > >&}; _Tp = std::future<std::vector<std::__cxx11::basic_string<char> > >]’:
/usr/include/c++/9/bits/alloc_traits.h:482:2: required from ‘static void std::allocator_traits<std::allocator<_CharT> >::construct(std::allocator_traits<std::allocator<_CharT> >::allocator_type&, _Up*, _Args&& ...) [with _Up = std::future<std::vector<std::__cxx11::basic_string<char> > >; _Args = {const std::future<std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > > >&}; _Tp = std::future<std::vector<std::__cxx11::basic_string<char> > >; std::allocator_traits<std::allocator<_CharT> >::allocator_type = std::allocator<std::future<std::vector<std::__cxx11::basic_string<char> > > >]’
/usr/include/c++/9/bits/stl_vector.h:1189:30: required from ‘void std::vector<_Tp, _Alloc>::push_back(const value_type&) [with _Tp = std::future<std::vector<std::__cxx11::basic_string<char> > >; _Alloc = std::allocator<std::future<std::vector<std::__cxx11::basic_string<char> > > >; std::vector<_Tp, _Alloc>::value_type = std::future<std::vector<std::__cxx11::basic_string<char> > >]’
/Server/cpp_server/src/_server.cpp:175:35: required from here
/usr/include/c++/9/ext/new_allocator.h:145:20: error: use of deleted function ‘std::future<_Res>::future(const std::future<_Res>&) [with _Res = std::vector<std::__cxx11::basic_string<char> >]’
145 | noexcept(noexcept(::new((void *)__p)
| ^~~~~~~~~~~~~~~~~~
146 | _Up(std::forward<_Args>(__args)...)))
| ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
In file included from /Server/cpp_server/src/_server.cpp:4:
/usr/include/c++/9/future:782:7: note: declared here
782 | future(const future&) = delete;
| ^~~~~~
make[2]: *** [CMakeFiles/_server.dir/build.make:63: CMakeFiles/_server.dir/src/_server.cpp.o] Error 1
make[1]: *** [CMakeFiles/Makefile2:76: CMakeFiles/_server.dir/all] Error 2
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|
